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Accountability  *  Integrity  *  Reliability 


United  States  General  Accounting  Office 
Washington,  DC  20548 


November  28,  2001 

The  Honorable  Charles  E.  Grassley 
Ranking  Minority  Member 
The  Honorable  Jeff  Sessions,  Member 
Subcommittee  on  Youth  Violence 
Committee  on  the  Judiciary 
United  States  Senate 

This  report  responds  to  your  request  that  we  review  selected  aspects  of 
the  U.S.  Department  of  Justice’s  (DOJ)  Office  of  Justice  Program’s  (OJP) 
grant  monitoring  and  evaluation  efforts.  Specifically,  this  report  discusses 
the  program  monitoring  of  discretionary  grants  awarded  by  the  Bureau  of 
Justice  Assistance’s  (BJA)  Byrne  Program'  and  the  Violence  Against 
Women  Office  (VAWO)  within  OJP.  Between  fiscal  years  1997  and  2000, 
Byrne  and  VAWO  discretionary  grant  awards  grew,  in  constant  2000 
dollars,  about  85  percent — from  about  $105  million  to  approximately  $194 
million.  These  funds  were  awarded  directly  to  various  organizations,  such 
as  state  and  local  governments,  either  on  a  competitive  basis  or  pursuant 
to  legislation  allocating  funds  through  congressional  earmarks.  BJA  and 
VAWO,  together  with  OJP’s  Office  of  the  Comptroller,  were  responsible  for 
monitoring  these  grants  to  ensure  that  they  were  being  implemented  as 
intended,  responsive  to  grant  goals  and  objectives,  and  compliant  with 
statutory  regulations  and  other  policy  guidelines. 

To  address  your  request,  we  reviewed  and  are  reporting  on  (1)  OJP’s 
discretionary  grant  monitoring  process  and  requirements,  (2)  the  extent  to 
which  BJA  and  VAWO  documented  their  monitoring  activities  for 
discretionary  grants,  (3)  what  BJA  and  VAWO  do  to  determine  compliance 
with  OJP’s  grant  monitoring  guidelines,  and  (4)  OJP’s  efforts  to  identify 
and  address  grant  monitoring  problems.''  To  meet  our  objectives,  we 
interviewed  agency  officials  and  grant  managers  and  supervisors  in 
Washington,  D.C.;  reviewed  OJP,  BJA,  and  VAWO  policies,  procedures. 


'The  Edward  Byrne  Memorial  State  and  Local  Law  Enforcement  Assistance  Program 
Discretionary  Grants  Program  is  the  largest  single  discretionary  grant  program  within  BJA. 

^In  October  2001,  we  issued  a  similar  report  on  the  documentation  of  discretionary  grant 
monitoring  by  OJP’s  Office  of  Juvenile  Justice  and  Delinquency  Prevention,  entitled 
Juvenile  Justice:  Better  Documentation  of  Discretionary  Grant  Monitoring  Is  Needed 
(GAO-02-65,  Oct.  10,  2001). 
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and  practices  for  and  OJP  reports  on  administering  and  monitoring  grants; 
analyzed  data  from  a  representative  sample  of  46  of  110  Byrne  and  84  of 
635  VAWO  grant  files  active  during  1999  and/or  2000;  and  analyzed  OJP, 
BJA,  and  VAWO  budget  data  on  OJP  grant  programs  from  fiscal  years  1990 
through  2000.  As  agreed  with  your  staff,  we  focused  on  monitoring 
activities  associated  with  the  Byrne  and  VAWO  discretionary  grant 
programs  that  supported  a  program  or  theme,  rather  than  those  that 
supported  training  and  technical  assistance. 

Our  analysis  did  not  address  how  well  BJA  and  VAWO  monitored  their 
grantees.  For  example,  we  reviewed  documentation  to  determine  whether 
BJA  and  VAWO  made  the  site  visits  they  said  they  would  conduct,  but  it 
was  not  feasible  to  review  how  well  they  conducted  the  site  visits.  Further, 
we  did  not  examine  OJP’s  efforts  to  conduct  financial  monitoring  of  Byrne 
and  VAWO  discretionary  grants  through  the  Office  of  Comptroller.  For 
purposes  of  this  report,  a  grant  consists  of  an  initial  award  and  any 
subsequent  supplemental  awards.  Thus,  when  we  reviewed  a  grant  file,  we 
reviewed  all  award  files  within  each  grant. 


Results  in  Brief 


OJP  has  monitoring  and  documentation  requirements  for  its  discretionary 
grants.  The  monitoring  requirements  include  the  development  of 
monitoring  plans  that  articulate  who  will  conduct  monitoring,  the  manner 
in  which  it  will  be  done,  and  when  and  what  type  of  monitoring  activities 
are  planned.  Grant  managers  are  to  maintain  documentation  in  grant  files 
on  their  monitoring  activities,  using  such  techniques  as  written  reports  of 
on-site  reviews  and  telephone  interview  write-ups.  Grant  files  are  also  to 
include  program  and  financial  progress  reports  submitted  by  grantees  to 
OJP  at  defined  intervals,  and  grant  managers  are  to  notify  grantees  when 
reports  are  delinquent.  In  addition,  when  grants  are  closed,  grant  files  are 
supposed  to  contain  key  documents,  including  all  financial  and  progress 
reports  and  the  final  accounting  of  federal  funds. 

Our  review  of  a  representative  sample  of  46  Byrne  and  84  VAWO 
discretionary  grants  showed  that  they  did  not  always  contain  the  required 
monitoring  plans:  an  estimated  29  percent  of  Byrne  and  11  percent  of 
VAWO  award  files  did  not  contain  monitoring  plans.  In  addition,  for 
awards  covering  the  most  recent  12-month  period  of  grant  activity,  grant 
managers  were  not  consistently  documenting  their  monitoring  activities 
according  to  the  monitoring  plans  they  developed.  For  example,  25  of  46 
Byrne  and  53  of  84  VAWO  files  had  plans  with  specific  criteria  for  site 
visits.  Of  these  25  Byrne  files,  21  did  not  contain  documentation  to  show 
whether  all  the  planned  site  visits  occurred.  For  the  VAWO  files,  we 
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estimate  that  90  percent  of  all  files  did  not  contain  documentation  that  all 
the  planned  site  visits  occurred.  Our  review  of  grant  files  also  showed  the 
following: 

•  A  substantial  number  of  Byrne  and  VAWO  files  did  not  contain  progress 
and  financial  reports  sufficient  to  cover  the  entire  grant  period.  For 
example,  an  estimated  70  percent  of  Byrne  and  66  percent  of  VAWO  files 
did  not  have  progress  reports  to  cover  the  complete  grant  period,  and  an 
estimated  41  percent  of  Byrne  and  36  percent  of  VAWO  grant  files  did  not 
contain  financial  reports  covering  the  full  grant  period.  In  addition,  seven 
of  the  files  we  reviewed — three  Byrne  and  four  VAWO — did  not  contain 
any  of  the  required  grantee  progress  reports. 

•  Progress  and  financial  reports  were  often  submitted  late  by  grantees.  An 
estimated  68  percent  of  Byrne  and  85  percent  of  VAWO  progress  reports 
were  late,  and  53  percent  of  Byrne  and  54  percent  of  VAWO  financial 
reports  were  late. 

•  The  Byrne  and  VAWO  files  we  reviewed  did  not  always  contain  the 
required  closeout  documents.  There  were  not  enough  closed  Byrne  or 
VAWO  grants  to  ensure  that  our  assessment  was  representative  of  all  grant 
closeouts.  However,  our  limited  review  showed  that  of  the  19  closed  Byrne 
grants  we  reviewed,  15  did  not  contain  documentation  of  the  required 
precloseout  contact  with  the  grantee,  10  did  not  contain  the  final  progress 
report,  and  7  did  not  contain  the  final  financial  report.  Of  the  3  closed 
VAWO  grants  we  reviewed,  3  did  not  contain  documentation  of  the 
required  precloseout  contact  with  the  grantee,  2  did  not  contain  the  final 
progress  report,  and  1  did  not  contain  the  final  financial  report. 

BJA  and  VAWO  are  not  positioned  to  systematically  oversee  grant 
managers’  compliance  with  monitoring  requirements  because 
documentation  is  not  readily  available  on  monitoring  activities.  Both  BJA 
and  VAWO  rely  on  staff  meetings  and  discussions  with  staff  to  identify 
grant  problems  or  monitoring  issues,  and  neither  have  management 
information  systems  that  enable  them  to  compile  and  analyze  data  about 
most  monitoring  activities.  The  lack  of  systematic  data  for  monitoring 
grant  manager  compliance,  combined  with  a  failure  to  document 
monitoring  activities,  could  impede  BJA  and  VAWO’s  ability  to  measure 
their  performance  consistent  with  the  Government  Performance  and 
Results  Act  of  1993  (GPRA).**  For  example,  DOJ’s  Fiscal  Year  2000 
Performance  Report  and  2002  Performance  Plan  list  three  VAWO  program 


fy.L.  103-62. 
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targets  and  performance  measures  for  which  needed  performance  data  are 
to  be  derived  from  grantee  progress  reports,  on-site  monitoring,  and 
VAWO  program  office  files — all  validated  and  verified  through  a  review  of 
monitoring  information.  Although  the  performance  report  and  plan  state 
that  the  goals  and  measures  have  no  known  limitations,  questions  arise  as 
to  whether  inconsistent  documentation  and  the  lack  of  systematic  data 
could  hinder  VAWO’s  ability  to  measure  whether  it  is  achieving  its  goals. 

Problems  with  OJP  grant  monitoring  are  not  new.  Over  the  last  few  years, 
we  and  others,  including  OJP,  have  identified  various  grant  monitoring 
problems  among  OJP’s  bureaus  and  offices.  For  example,  since  1996,  we 
have  testified  and  issued  reports  that  discuss  inconsistent  documentation 
of  discretionary  grant  monitoring  activities  in  OJP’s  Office  of  Juvenile 
Justice  and  Delinquency  Prevention  and  Executive  Office  for  Weed  and 
Seed.  In  addition,  reports  by  or  for  OJP  have  found  similar  problems 
among  OJP’s  bureaus  and  offices.  The  DOJ  Office  of  Inspector  General  has 
declared  OJP  grant  management  a  major  management  challenge.  OJP  has 
begun  to  work  with  its  bureaus  and  offices,  like  BJA  and  VAWO,  to 
address  these  problems,  but  it  is  too  early  to  tell  whether  OJP’s  efforts  will 
effectively  resolve  many  of  the  issues  we  and  others,  including  OJP  itself, 
have  identified.  For  example,  although  OJP  has  issued  new  guidance  on 
grant  monitoring  and  is  soliciting  the  opinions  of  grant  managers  regarding 
the  usefulness  of  its  new  guidance,  OJP  has  not  considered  what  it  plans 
to  do  to  test  compliance  and  ensure  that  grant  managers  are  documenting 
their  activities. 

We  are  making  recommendations  regarding  (1)  BJA  and  VAWO’s  need  to 
improve  their  documentation  of  discretionary  grant  monitoring  and  (2) 
OJP’s  need  to  establish  an  approach  to  compile,  maintain,  and 
systematically  review  documentation  of  monitoring  activities. 

In  commenting  on  a  draft  of  this  report,  OJP’s  Assistant  Attorney  General 
said  that  overall,  the  report  provides  useful  information  by  highlighting 
monitoring  activities  that  need  improvement  (see  appendix  111).  She  noted 
that  BJA  and  VAWO  had  already  taken  steps  to  address  our 
recommendations  regarding  their  monitoring  activities,  but  she  was  silent 
about  what  OJP  planned  to  do  to  address  our  recommendations  regarding 
OJP’s  need  to  establish  an  approach  to  compile,  maintain,  and 
systematically  review  documentation  of  monitoring  activities.  We 
acknowledge  that  BJA  and  VAWO  appear  to  be  taking  steps  in  the  right 
direction.  However,  until  their  actions  become  operational,  BJA  and 
VAWO  will  not  be  able  to  determine  why  the  problems  we  identified 
occurred  so  that  they  can  take  corrective  action.  In  addition,  although 
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these  steps  might  help  BJA  and  VAWO  better  understand  and  act  upon  the 
problems  we  identified,  they  appear  to  be  specific  to  those  organizations. 
Thus,  it  is  unclear  whether  and  to  what  extent  these  actions  can  be  applied 
OJP-wide  so  that  OJP  can  begin  to  address  the  long-standing  monitoring 
problems  we  and  others,  including  OJP,  have  identified. 


Background 


OJP,  the  grant-making  arm  of  DOJ,  provides  grants  to  various 
organizations,  including  state  and  local  governments,  universities,  and 
private  foundations,  that  are  intended  to  develop  the  nation’s  capacity  to 
prevent  and  control  crime,  administer  justice,  and  assist  crime  victims. 
OJP’s  Assistant  Attorney  General  is  responsible  for  overall  management 
and  oversight  of  OJP  through  setting  policy  and  for  ensuring  that  OJP 
policies  and  programs  reflect  the  priorities  of  the  President,  the  Attorney 
General,  and  the  Congress.  The  Assistant  Attorney  General  promotes 
coordination  among  the  various  bureaus  and  offices  within  OJP,  including 
BJA,  one  of  the  five  bureaus  within  OJP,  and  VAWO,  one  of  OJP’s  seven 
program  offices.^  In  fulfilling  its  mission,  BJA  provides  grants  for  site- 
based  programs  and  for  training  and  technical  assistance  to  combat 
violent  and  drug-related  crime  and  help  improve  the  criminal  justice 
system.  VAWO  administers  grants  to  help  prevent,  detect,  and  stop 
violence  against  women,  including  domestic  violence,  sexual  assault,  and 
stalking. 

Since  1996,  OJP’s  budget  has  increased  substantially,  following  the 
passage  of  the  Violent  Crime  Control  and  Law  Enforcement  Act  of  1994.^ 
Figure  1  shows  changes  to  OJP’s  budget  from  fiscal  year  1990  through 
fiscal  year  2000  and  compares  those  changes  in  relation  to  BJA’s  budget 
over  the  same  period  and  VAWO’s  budget  since  its  inception  in  1995. 


^OJP’s  five  bureaus  are  Bureau  of  Justice  Assistance,  Bureau  of  Justice  Statistics,  National 
Institute  of  Justice,  Office  of  Juvenile  Justice  and  Delinquency  Prevention,  and  Office  for 
Victims  of  Crime.  OJP’s  seven  program  offices  are  American  Indian  &  Alaska  Native  Affairs 
Desk,  Violence  Against  Women  Office,  Executive  Office  for  Weed  and  Seed,  Corrections 
Program  Office,  Drug  Courts  Program  Office,  Office  for  State  and  Local  Domestic 
Preparedness  Support,  and  Office  of  the  Police  Corps  and  Law  Enforcement  Education. 

^P.L.  103-322. 
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Figure  1:  Overall  OJP,  BJA,  and  VAWO  Yearly  Budget  Resources 


4,500,000  Thousands  of  Dollars 
4,000,000 


Fiscal  Year 


I _ I  Other  OJP  Bureaus  and  Oftices  Resources 

I  I  BJA  Resources 

[  >|  VAWO  Resources 

Note  1 :  According  to  OJP  budget  officials,  yearly  figures  include  all  funds  appropriated  to  OJP, 
transfers  from  other  agencies,  and  receipts  from  the  Crime  Victim  Fund,  which  is  derived  not  from  tax 
dollars,  but  from  fines  and  penalties  paid  by  federal  criminal  offenders.  However,  the  yearly  figures  do 
not  include  grants  awarded  and  administered  by  OJP  bureaus  and  offices  for  other  federal  agencies 
(including  other  DOJ  agencies)  under  reimbursable  agreements.  Also,  the  yearly  amounts  do  not 
include  direct  appropriations  for  OJP  management  and  administration.  The  large  funding  increase  for 
fiscal  year  1996  resulted  from  the  Omnibus  Consolidated  Recissions  and  Appropriations  Act  of  1996, 
which  appropriated  funds  authorized  by  the  Violent  Crime  Control  and  Law  Enforcement  Act  of  1994. 

Note  2:  The  budget  amounts  for  each  fiscal  year  are  adjusted  to  constant  fiscal  year  2000  dollars. 

Source:  OJP  Office  of  Budget  and  Management  Services. 

One  of  BJA’s  major  grant  programs  is  the  Edward  Byrne  Memorial  State 
and  Local  Law  Errforcement  Assistance  Program.®  Under  the  Byrne 
Discretionary  Grants  Program,  BJA  provides  federal  financial  assistance  to 
grantees  for  educational  and  training  programs  for  criminal  justice 
personnel;  technical  assistance  to  state  and  local  units  of  government;  and 
projects  that  are  replicable  in  more  than  one  jurisdiction  nationwide.  In 
fiscal  year  2000,  BJA  awarded  99  Byrne  discretionary  grants  worth  about 
$69  million. 


®Local  law  enforcement  programs  established  by  the  Anti-Drug  Abuse  Act  of  1986  (P.L.  99- 
570)  were  amended  and  renamed  the  Edward  Byrne  Memorial  State  and  Local  Law 
Enforcement  Assistance  Program  by  the  Anti-Drug  Abuse  Act  of  1988  (P.L.  100-690).  The 
Byrne  grant  program  is  codified  at  42  U.S.C.  3750-3766b.  The  Byrne  program  is  one  of 
approximately  20  programs  administered  by  BJA. 
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VAWO  was  created  in  1995  to  carry  out  certain  programs  created  under 
the  Violence  Against  Women  Act  of  1994/  The  Victims  of  Trafficking  and 
Violence  Prevention  Act  of  2000®  reauthorized  most  of  the  exisiting  VAWO 
programs  and  added  new  programs  as  well.  VAWO’s  mission  is  to  lead  the 
national  effort  to  end  violence  against  women,  including  domestic 
violence,  sexual  assault,  and  stalking.  VAWO  programs  seek  to  improve 
criminal  justice  system  responses  to  these  crimes  by  providing  support  for 
law  enforcement,  prosecution,  courts,  and  victim  advocacy  programs 
across  the  country.  In  addition,  programs  are  to  enhance  direct  services 
for  victims,  including  victim  advocacy,  emergency  shelter,  and  legal 
services.  VAWO  also  addresses  violence  against  women  issues 
internationally,  including  working  to  prevent  trafficking  in  persons.  In 
fiscal  year  2000,  VAWO  awarded  425  discretionary  grants  worth  about 
$125  million. 

Appendix  1  discusses  the  growth  in  OJP,  BJA,  and  VAWO  budgets  and 
provides  information  on  the  number  and  amount  of  BJA  and  VAWO 
discretionary  grants  awarded  from  fiscal  year  1990  to  fiscal  year  2000. 


Scope  and 
Methodology 


To  meet  our  objectives,  we  conducted  our  work  at  OJP,  BJA,  and  VAWO 
headquarters  in  Washington,  D.C.  We  reviewed  applicable  laws  and 
regulations  and  OJP,  BJA,  and  VAWO  policies  and  procedures  for 
awarding  and  managing  grants,  and  we  interviewed  responsible  OJP,  BJA, 
and  VAWO  officials,  including  grant  managers.  As  agreed  with  your 
offices,  we  focused  on  monitoring  activities  associated  with  the  Byrne  and 
VAWO  discretionary  grant  programs.  In  particular,  we  focused  on  grant 
monitoring  for  grants  that  were  active  during  fiscal  years  1999  and  2000 
and  supported  a  program  or  theme,  rather  than  technical  assistance  or 
training  efforts. 

To  address  our  first  objective,  concerning  OJP’s  process  and  requirements 
for  discretionary  grant  monitoring,  we  reviewed  applicable  laws  and 
regulations  and  OJP  policies  and  procedures  for  grant  administration  and 
grant  monitoring.  We  also  interviewed  OJP,  Comptroller,  BJA,  and  VAWO 
staff.  We  obtained  information  about  the  Comptroller’s  Control  Desk, 
which  maintains  the  official  grant  files  and  is  responsible  for  receiving. 


■^Title  IV  of  the  Crime  Act  (P-L.  103-322). 
®P.L.  106-386. 
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distributing,  and  tracking  grant  documents,  including  financial  and 
progress  reports. 

To  address  our  second  objective  regarding  the  extent  to  which  BJA  and 
VAWO  documented  their  monitoring  activities  for  discretionary  grants,  we 
reviewed  representative  samples  of  official  grant  files  and  grant  manager 
files  using  a  data  collection  instrument  to  record  whether  evidence  of  the 
required  monitoring  activity — progress  reports,  financial  reports,  and 
other  required  documents — were  included  in  the  files.  For  each  grant,  we 
also  reviewed  the  most  recent  award  covering  12  months  to  examine  the 
documentation  of  specific  monitoring  requirements  and  activities,  such  as 
telephone  calls  and  site  visits.'*  Specifically,  we  reviewed  a  random  sample 
of  46  of  110  Byrne  and  84  of  635  VAWO  discretionary  grants  that  had  a 
program  theme  and  were  active  throughout  fiscal  year  1999  or  2000.  The 
results  of  the  samples  are  representative  of  the  populations  from  which 
they  were  drawn.  We  express  our  confidence  in  the  precision  of  our 
sample  results  as  a  95-percent  confidence  interval.  Unless  otherwise 
noted,  all  confidence  intervals  are  less  than  or  equal  to  plus  or  minus  10 
percentage  points. 

In  regard  to  grantee  financial  and  progress  reports,  we  reviewed  all 
available  reports  for  the  BJA  and  VAWO  discretionary  grants  included  in 
our  sample  from  the  initiation  of  the  grant  through  December  31,  2000.  We 
determined  timeliness  using  dates  recorded  on  reports  compared  with  the 
specified  intervals  when  they  were  supposed  to  be  received.  Also,  to 
determine  whether  BJA  and  VAWO  closeout  procedures  were 
implemented  in  accordance  with  OJP  policy,  we  reviewed  those  grant  files 
in  our  sample  when  the  grant  end  date  was  between  September  30,  1999, 
and  August  31,  2000.  For  our  review,  we  focused  on  required  closeout 
documentation,  such  as  precloseout  contacts,  closeout  checklists,  and 
final  financial  and  progress  reports. 

To  address  our  third  objective,  regarding  how  BJA  and  VAWO  determine 
compliance  with  OJP  monitoring  requirements,  we  requested  information 
on  any  existing  oversight  and  review  processes  relating  to  grant 


grant  consists  of  an  initial  award,  any  subsequent  supplemental  awards  and  grant 
adjustment  notices.  Grant  adjustment  notices  are  completed  for  changes  to  the  grant  (e.g., 
project  period  extensions  or  budget  modifications).  Once  reviewed  and  certified,  the  grant 
adjustment  notice  communicates  approval  of  such  changes  by  the  appropriate  OJP  office. 
Therefore,  when  we  reviewed  a  grant  file,  we  reviewed  all  award  files  within  each  grant,  as 
well  as  all  relevant  grant  adjustment  notices. 
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monitoring  at  BJA  and  VAWO  and  gathered  and  reviewed  documentation 
that  BJA  and  VAWO  officials  provided  concerning  their  oversight 
processes.  We  also  met  with  BJA  and  VAWO  officials  to  obtain  information 
on  any  new  initiatives  they  had  to  address  the  oversight  and  management 
of  their  grants. 

To  meet  our  fourth  objective,  on  OJP’s  efforts  to  identify  and  address 
grant  management  problems,  we  met  with  OJP  officials  to  discuss  their 
efforts,  and  we  reviewed  reports  and  documents  they  had  prepared  about 
the  new  Grant  Management  System  (GMS),  revisions  to  the  OJP  Handbook 
and  associated  decision  documents,  and  other  initiatives.  In  addition,  we 
reviewed  the  DOJ  Fiscal  Year  2000  Performance  Report  and  Fiscal  Year 
2002  Performance  Plan  and  information  on  grant  management  developed 
by  the  DOJ’s  Office  of  the  Inspector  General. 

Finally,  to  obtain  information  on  the  size  and  growth  of  BJA  and  VAWO 
grant  programs  within  the  context  of  OJP,  we  obtained  and  analyzed 
budget  and  resource  data  from  OJP  on  grant  funds  and  programs  from 
fiscal  years  1990  through  2000. 

We  conducted  our  work  between  October  2000  and  October  2001  in 
accordance  with  generally  accepted  government  auditing  standards. 

We  requested  comments  on  a  draft  of  this  report  from  DOJ  on  October  24, 
2001.  Its  comments  are  discussed  near  the  end  of  this  letter  and  are 
reprinted  as  appendix  111.  DOJ  also  provided  technical  comments  that 
were  incorporated  in  the  report. 


Discretionary  Grant 
Monitoring  and 
Requirements 


After  BJA  and  VAWO  award  discretionary  grants,  OJP  policies  require 
them,  in  coordination  with  Office  of  the  Comptroller,  to  monitor  grants 
and  related  activities  and  document  the  monitoring  results.  Monitoring  is 
done  to  ensure 

compliance  with  relevant  statutes,  regulations,  policies,  and  guidelines; 
responsible  oversight  of  awarded  funds; 

implementation  of  approved  programs,  goals,  objectives,  tasks,  products, 
time  lines,  and  schedules; 

identification  of  issues  and  problems  that  may  impede  grant 
implementation;  and 

implementation  of  adjustments  by  the  grantee  as  approved  by  BJA  or 
VAWO. 
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The  OJP  Handbook  is  the  basic  reference  for  OJP  policies  and  procedures 
for  the  administration  of  OJP  grants,  including  discretionary  grant 
monitoring.“  According  to  the  Handbook,  each  grant  manager  is  to 
prepare  a  monitoring  plan  as  part  of  a  grant  manager’s  memorandum 
recommending  initial  or  continuation  funding.  The  level  of  monitoring  is  to 
be  based  on  the  stated  monitoring  plan  in  the  grant  manager’s 
memorandum.  The  plan  is  to  contain  information  on  who  will  conduct  the 
monitoring,  how  it  will  be  done,  and  when  and  what  type  of  monitoring 
activities  are  planned.  Monitoring  information  is  to  be  collected  using  such 
techniques  as  on-site  visits,  telephone  calls,  and  desk  reviews,  which  are 
reviews  to  ensure  that  the  grant  files  are  complete  and  the  grantee  is  in 
compliance  with  the  program  guidelines. 

In  addition,  grant  managers  are  to  review  grantee  program  and  financial 
progress  reports.  According  to  OJP’s  Handbook,  grantees  are  required  to 
submit  periodic  progress  reports  that  summarize  project  activities  to  aid 
program  and  grant  managers  in  carrying  out  their  responsibilities  for 
grant-supported  activities.’^  Likewise,  grantees  are  required  to  submit 
periodic  financial  status  reports  to  update  OJP  on  how  grant  funds  are 
being  spent.  In  addition,  OJP  requires  that  grant  managers  close  out  the 
grant  when  the  project  period  ends  to  ensure  that  the  agency  has  received 
all  required  financial,  programmatic,  and  audit  reports  and  that  all  federal 
funds  have  been  accounted  for. 

OJP  bureaus  and  program  offices,  such  as  BJA  and  VAWO,  are  to  carry  out 
the  program  (nonfiscal)  monitoring  aspects  of  the  grants  they  award. 
During  fiscal  year  2000,  BJA  had  approximately  20  program  managers 
responsible  for  the  monitoring  activities  for  most  nonformula  BJA  grants. 
Generally,  each  BJA  program  manager  had  responsibility  for  monitoring 
25  to  40  discretionary  grants,  including  those  under  the  Byrne  program. 
VAWO  had  13  program  managers,  each  of  whom  had  responsibility  for  the 
program  monitoring  aspects  for  about  60  VAWO  grants,  including  VAWO 
discretionary  grants. 


’°OJP,  OJP  Handbook:  Policies  and  Procedures  for  the  Administration  of  OJP  Grants 
(Washington,  D.C.:  Feb.  1992).  In  January  2001,  OJP  released  Grant  Management  Policies 
and  Procedures  Manual  to  update  OJP’s  policies  and  procedures  for  grant  management 
activities.  This  manual  supersedes  and  cancels  the  1992  Handbook.  The  revised  policies 
and  procedures  were  not  applicable  to  the  grant  periods  covered  by  our  review. 

”ln  1996,  OJP  changed  its  procedures  to  require  grantees  to  submit  progress  reports 
semiannually.  Before  then,  grantees  had  to  submit  progress  reports  quarterly. 
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The  Office  of  the  Comptroller  has  primary  responsibility  for  monitoring 
the  fiscal  aspects  of  all  OJP-awarded  grants,  including  those  awarded  by 
BJA  and  VAWO.  To  assess  grantee  financial  records,  the  Comptroller’s 
Monitoring  Division  is  to  perform  risk-based,  on-site  financial  reviews  for 
a  sample  of  grantee  organizations  to  monitor  administrative  and  financial 
capability/^  The  Monitoring  Division  is  to  review  various  program  and 
financial  documents  contained  in  the  official  grant  files  to  ensure  that  they 
are  complete  and  the  documents  are  properly  executed.  For  discretionary 
grants,  the  Monitoring  Division  conducted  36  desk  reviews  for  Byrne  and 
38  for  VAWO  discretionary  grants  in  fiscal  year  1999  and  6  desk  reviews 
for  Byrne  and  16  for  VAWO  discretionary  grants  in  fiscal  year  2000.  In 
addition,  the  Control  Desk  is  to  maintain  the  official  grant  files  and  is 
responsible  for  tracking  the  receipt  of  all  grantee  documents.  The  Control 
Desk  is  to  receive  grantee  progress  and  financial  reports,  log  the  date  of 
receipt  into  a  tracking  system,  file  the  original  in  the  official  grant  file,  and 
forward  a  copy  to  the  cognizant  program  office.  The  Control  Desk  also  is 
to  generate  a  monthly  report  on  delinquent  progress  and  financial  reports, 
which  is  distributed  to  responsible  officials  within  bureaus  and  program 
offices.  BJA  and  VAWO  grant  managers  are  responsible  for  ensuring  that 
grantees  submit  timely  progress  and  financial  reports  and  are  to  contact 
the  grantee  if  reports  are  delinquent. 


Appendix  11  discusses  grant  monitoring  within  the  context  of  the  grant 
award  process  throughout  the  life  of  a  grant. 


BJA  and  VAWO  Grant 
Files  Did  Not  Always 
Contain  Adequate 
Documentation  That 
Monitoring  Occurred 


OJP  requires  that  grant  managers  document  their  monitoring  of  the  grants. 
This  documentation  is  to  include  both  the  grant  manager’s  written  plan  for 
monitoring  the  project  and  grantee  progress  and  financial  reports.  In 
addition,  OJP  requires  certain  documentation  at  the  time  of  grant 
closeouts  from  both  the  grantee  and  the  grant  manager.  Byrne  and  VAWO 
grant  files  did  not  always  contain  monitoring  plans,  and  grant  managers 
were  not  consistently  documenting  their  monitoring  activities,  according 
to  the  monitoring  plans  that  we  reviewed.  In  fact,  for  those  award  files 
representing  the  most  recent  12-month  period  of  activity  for  each  grant, 
few  contained  records  to  show  that  such  activities  as  telephone  contacts 
and  site  visits  occurred.  Furthermore,  the  progress  and  financial  reports 
did  not  always  cover  the  entire  period  covered  by  the  award,  a  few  grants 


^^The  Comptroller’s  Monitoring  Division  applies  risk-based  criteria  to  a  universe  of  grants 
to  develop  a  sample  for  each  fiscal  year’s  monitoring  plan  based  on  the  dollar  amount  of 
the  grant,  new  grantees,  new  grant  programs,  and  programs  with  known  problems. 
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were  missing  all  progress  reports,  and  progress  and  financial  reports  were 
often  late.  For  those  closed  grants  that  we  reviewed,  key  documents, 
which  are  to  ensure  a  final  accounting  of  federal  funds  and  show  whether 
the  grantee  met  the  programmatic  goals  of  the  grant,  were  sometimes 
missing. 


Missing  Monitoring  Plans 
and  Inadequately 
Documented  Monitoring 
Activities 


Our  review  of  grant  files  showed  that  monitoring  plans  were  not  always  in 
the  files.  Each  grant  may  contain  one  or  more  individual  grant  awards,^^ 
and  for  each  award,  OJP  requires  that  grant  managers  prepare  a 
monitoring  plan  containing  information  on,  among  other  things,  who  will 
conduct  the  monitoring,  how  it  will  be  done,  and  when  and  what  type  of 
monitoring  activities  and  reports  are  planned.  Our  review  of 
documentation  on  the  awards  in  46  Byrne  grant  files  and  84  VAWO  grant 
files  showed  that  an  estimated  29  percent  of  the  Byrne  awards  and  about 
11  percent  of  the  VAWO  awards  did  not  contain  a  grant  manager’s 
monitoring  plan.“ 


We  also  compared  the  planned  monitoring  activities  in  the  monitoring 
plans  for  the  most  recent  12-month  period  of  grant  activity  for  each  of  the 
46  Byrne  and  84  VAWO  grant  files  to  actual  monitoring  documentation.  Of 
those  files  that  contained  a  monitoring  plan,  some  had  specific  plans  for 
monitoring,  while  others  did  not.  When  the  file  contained  a  plan  that 
outlined  the  type  of  monitoring  and  its  frequency,  our  review  showed  that 
the  documentation  in  the  files  was  inadequate  to  demonstrate  whether  or 
not  BJA  and  VAWO  grant  managers  were  consistently  following  the 
monitoring  plans.  For  Byrne  files,  there  were  not  enough  monitoring  plans 
with  specific  planned  activities  to  ensure  that  our  assessment  was 
representative  of  all  the  awards.  However,  our  limited  comparisons  of 
planned  to  actual  documentation  regarding  phone  contacts,  site  visits,  and 
desk  reviews  revealed  the  following: 


•  Phone  Contacts.  13  of  46  Byrne  files  contained  monitoring  plans  that 
specified  the  planned  number  and  frequency  (e.g.,  monthly  or  quarterly)  of 
telephone  contacts  to  be  made.  Of  those  13  files,  none  contained 
documentation  to  show  that  all  of  the  planned  number  of  telephone 
contacts  occurred.  Furthermore,  4  of  the  13  files  had  documentation  that 
showed  that  some,  but  not  all,  of  the  planned  telephone  contacts  had  been 


^^For  further  discussion  of  the  life  of  a  grant  and  subsequent  awards,  see  appendix  II. 

^rihe  46  Byrne  grants  contained  76  awards,  and  the  84  VAWO  grants  contained  152  awards. 
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made,  while  the  remaining  9  files  contained  no  documentation  that  any 
telephone  contacts  occurred. 

•  Site  Visits.  25  of  46  Byrne  files  contained  monitoring  plans  that  specified 
the  number  of  grantee  site  visits  to  be  conducted,  but  only  4  of  25  files 
contained  documentation  that  showed  that  the  planned  number  of  site 
visits  occurred.  Only  1  of  the  25  files  had  documentation  that  some,  but 
not  all,  of  the  site  visits  had  been  made,  and  the  remaining  20  of  the  25  files 
contained  no  documentation  that  any  site  visits  occurred. 

•  Desk  Reviews.  15  of  46  Byrne  files  contained  monitoring  plans  that 
specified  the  frequency  of  desk  reviews  to  be  conducted.  However,  none 
of  the  files  showed  evidence  that  any  desk  reviews  were  conducted. 

Our  assessment  of  the  VAWO  files  provided  enough  cases  to  develop  a 
representative  sample  of  all  available  VAWO  monitoring  plans. 

Specifically,  our  review  of  planned  to  actual  monitoring  activities — phone 
contacts,  site  visits,  and  desk  reviews — showed  the  following: 

•  Phone  Contacts.  59  of  84  VAWO  files  contained  monitoring  plans  that 
specified  the  planned  number  and  frequency  (e.g.,  monthly  or  quarterly)  of 
telephone  contacts  to  be  made.  However,  none  contained  documentation 
to  show  that  the  planned  number  of  telephone  contacts  occurred. 
Furthermore,  we  estimate  that  56  percent  of  VAWO  files  had 
documentation  that  some,  but  not  all,  of  the  planned  telephone  contacts 
had  been  made,  and  44  percent  of  VAWO  files^*^  with  monitoring  plans 
containing  criteria  for  a  specific  number  of  telephone  contacts  had  no 
documentation  that  any  telephone  contacts  occurred. 


^^The  estimated  range  is  between  31  and  58  percent. 
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•  Site  Visits.  53  of  84  VAWO  files  contained  monitoring  plans  that  specified 
the  number  of  grantee  site  visits  to  be  conducted.^  We  estimate  that  10 
percent  of  VAWO  files'^  contained  documentation  that  the  planned  number 
of  site  visits  occurred.  Furthermore,  only  2  percent  of  VAWO  files  had 
documentation  that  even  some,  but  not  all,  of  the  planned  site  visits  had 
been  made,  while  the  remaining  88  percent  of  VAWO  files^*^  contained  no 
documentation  that  any  site  visits  occurred. 

•  Desk  Reviews.  47  of  84  VAWO  files  contained  monitoring  plans  that 
established  specific  criteria  for  the  frequency  of  desk  reviews.  However, 
none  of  the  VAWO  files  showed  evidence  that  any  desk  reviews  were 
conducted. 


Progress  and  Financial 
Reports  Did  Not  Cover  the 
Entire  Grant  Period  and 
Were  Often  Late 


OJP  requires  that  grantees  file  semiannual  progress  reports  and  quarterly 
financial  reports  throughout  the  life  of  a  grant.  Progress  reports  are  to 
supply  information  on  the  activities  and  accomplishments  of  the  grantee 
during  the  previous  reporting  period.  Financial  reports  are  to  show  the 
actual  expenditures  and  unliquidated  obligations  for  the  reporting  period 
(calendar  quarter)  and  cumulative  for  the  award.  We  found  Byrne  and 
VAWO  grant  files  in  which  progress  reports  and  financial  reports  did  not 
cover  the  entire  period  of  the  grant  and  a  few  files  with  no  evidence  of 
progress  reports.  We  also  found  that  progress  and  financial  reports  were 
often  late.  Combined,  these  factors  resulted  in  unaccounted  periods  of 
time,  where  OJP  had  either  no  information  or  no  up-to-date  information 
about  grantee  progress  or  financial  activities. 


For  example,  we  compared  the  time  periods  progress  and  financial  reports 
were  supposed  to  cover  with  the  time  periods  they  actually  covered  for 
each  of  the  Byrne  and  VAWO  grant  files  we  reviewed.  Based  on  our 
analysis  of  the  grant  files,  we  estimate  that  70  percent  of  the  Byrne  grants^ 
had  periods  of  time  during  the  grant  period  not  covered  by  progress 
reports,  and  41  percent  of  the  Byrne  grants^”  had  periods  of  time  not 
covered  by  financial  reports.  Likewise,  we  estimate  that  66  percent  of  the 


^^For  VAWO  site  visits,  our  estimates  are  based  on  51  files,  not  53,  because  we  did  not 
collect  the  necessary  documentation  on  2  of  the  files. 

^'^The  estimated  range  is  between  3  and  22  percent. 

^*The  estimated  range  is  between  76  and  96  percent. 

^^The  estimated  range  is  between  57  and  80  percent. 

^°The  estimated  range  is  between  30  and  54  percent. 
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VAWO  grants  had  periods  of  time  during  the  grant  period  not  covered  by 
progress  reports  and  36  percent  of  the  VAWO  grants  had  periods  of  time 
not  covered  by  financial  reports.  These  gaps,  cumulative  over  the  life  of 
the  grant,  ranged  from  as  little  as  2  weeks  to  over  3  years  for  progress 
reports  and  from  1  month  to  114  years  for  financial  reports.  With  regard  to 
progress  reports,  we  estimate  that  30  percent  of  Byrne  grants^'  and  18 
percent  of  VAWO  grants  had  more  than  12  months  that  were  not  covered. 
With  regard  to  financial  reports,  we  estimate  that  only  4  percent  of  grants 
at  both  BJA  and  VAWO  had  more  than  12  months  that  were  not  covered. 

Our  analysis  also  showed  that  a  few  grant  files  did  not  contain  any 
progress  reports.  For  the  files  we  reviewed,  seven — three  Byrne  and  four 
VAWO — contained  no  progress  reports.  We  noted  that  OJP  awarded  one 
VAWO  grantee  two  supplemental  awards  over  the  course  of  a  3-year 
period,  even  though  there  were  no  progress  reports  in  the  file.  In  total, 
these  seven  grant  files  without  progress  reports  represent  over  $2  million 
in  grantee  funds  awarded  over  a  6-year  period.  Finally,  we  noted  examples 
of  progress  reports  covering  more  than  the  required  6-month  period  and 
noted  that  one  VAWO  progress  report  that  was  submitted  to  cover  a  214- 
year  period  was  a  half-page  long.  Given  OJP’s  requirement  that  progress 
reports  are  to  be  submitted  for  each  6-month  period  of  the  grant,  the  fact 
that  reports  covered  periods  well  beyond  the  required  6  months  raises 
questions  about  whether  a  grant  manager  has  sufficient  information  to 
monitor  progress  and  identify  any  potential  grantee  problems. 

We  asked  BJA  and  VAWO  officials  why  these  seven  grant  files  did  not 
contain  any  progress  reports.  BJA’s  Acting  Director  at  the  time  of  our 
review  said  that  reorganizations  in  BJA  over  the  last  2  years  have 
contributed  to  difficulty  in  ensuring  complete  and  accurate  grant  files. 
VAWO  officials  explained  that  one  of  the  four  grant  files  involved  a 
grantee  that  had  some  grant  implementation  problems  that  have  since 
been  corrected  and  said  that  problems  aside,  the  grantee  had  been 
unaware  that  progress  reports  were  required  for  periods  of  grant 
inactivity.  They  said  that  another  of  the  four  grantees  had  been 
accustomed  to  the  reporting  requirements  for  formula  grants,  but  unaware 
of  different  reporting  requirements  for  discretionary  grants.  According  to 
VAWO  officials,  this  situation  has  since  been  corrected  and  the  files  have 
been  made  current.  VAWO  officials  were  unclear  about  why  another 
grantee  had  not  submitted  progress  reports.  However,  they  said  that  the 


^fyhe  estimated  range  is  between  20  and  43  percent. 
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one  grantee  that  had  been  awarded  two  supplemental  grants  is  now 
scheduled  for  closeout  because  of  the  extended  period  of  time  the  grantee 
has  been  delinquent  in  submitting  progress  reports.  In  addition,  VAWO 
officials  said  that  it  was  unacceptable  for  a  grantee  to  submit  a  half-page 
progress  report  covering  years. 

Our  review  of  grant  files  also  showed  that  late  reports  were  common. 

OJP  has  specific  guidance  that  spells  out  when  progress  and  financial 
reports  are  to  be  filed  by  grantees.  Progress  reports  are  due  30  days  after 
the  close  of  each  previous  6-month  period, and  financial  reports  are  to  be 
turned  in  45  days  after  the  end  of  the  calendar  quarter.  We  compared  the 
dates  progress  and  financial  reports  were  supposed  to  be  filed  by  grantees 
with  the  dates  they  were  actually  received  by  OJP’s  Office  of  the 
Comptroller.  We  estimate  that  68  percent  of  Byrne  and  85  percent  of 
VAWO  progress  reports  were  late.  However,  for  both  Byrne  and  VAWO,  we 
estimate  that  about  40  percent  of  all  reports  were  late  by  only  about  a 
month.  Table  1  shows  our  estimates  of  the  timeliness  of  Byrne  and  VAWO 
progress  reports. 


Table  1 :  Estimated  Timeliness  of  Progress  Report  Submissions 


Percent  iate 

30  days  31-90  91-180  181  days 


Percent  on  time 

or  less 

days 

days 

or  more 

Byrne 

32 

42 

15 

6 

5 

VAWO 

15 

43 

21 

9 

12 

Note  1 :  The  percentages  in  this  tabie  are  estimates  based  on  a  random  sampie  of  46  Byrne  and  84 
VAWO  discretionary  grant  fiies,  representing,  respectiveiy,  209  and  361  progress  reports  from  the 
initiation  of  the  grant  through  December  31 ,  2000.  Of  these  reports,  we  exciuded  7  at  BJA  and  13  at 
VAWO  because  of  data-reiated  probiems,  such  as  missing  submission  dafes.  The  esfimafes  are 
subject  to  sampiing  error.  The  95-percent  confidence  inten/als  for  fhe  esfimafes  are  within  pius  or 
minus  10  percent. 

Note  2:  Lateness  is  measured  by  the  number  of  days  beyond  the  deadiine  (30  days  after  the  ciose  of 
each  previous  6-month  period)  the  progress  report  is  submitted  to  OJP. 

Source:  GAO  analysis. 


reviewed  209  BJA  and  361  VAWO  progress  reports  and  458  BJA  and  811  VAWO 
financial  reports  in  the  files  from  the  initiation  of  the  grant  through  December  31,  2000.  Of 
these  reports,  we  excluded  7  BJA  progress,  4  BJA  financial,  13  VAWO  progress,  and  8 
VAWO  financial  reports  because  of  data-related  problems,  such  as  missing  submission 
dates. 

^^In  1996,  OJP  changed  its  procedures  to  require  grantees  to  submit  progress  reports 
semiannually.  Before  then,  grantees  had  to  submit  progress  reports  quarterly. 
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Similarly,  in  the  case  of  financial  reports,  our  review  showed  an  estimated 
53  percent  of  Byrne  and  54  percent  of  VAWO  financial  reports  were 
submitted  late.  Similar  to  progress  reports,  about  one-third  of  all  reports 
were  late  by  30  days  or  less.  Table  2  shows  our  estimates  of  timeliness  of 
Byrne  and  VAWO  financial  reports. 


Table  2:  Estimated  Timeliness  of  Financial  Report  Submissions 


Percent  late 


Percent  on  time 

30  days 
or  less 

31-90 

days 

91-180 

days 

181  days 
or  more 

Byrne 

47 

29 

11 

8 

5 

VAWO 

46 

29 

15 

6 

4 

Note  1 :  The  percentages  in  this  tabie  are  estimates  based  on  a  random  sampie  of  46  Byrne  and  84 
VAWO  discretionary  grants,  representing,  respectiveiy,  458  and  811  financiai  reports  from  the 
initiation  of  the  grant  through  December  31 ,  2000.  Of  these  reports,  we  exciuded  4  at  BJA  and  8  at 
VAWO  because  of  data-reiated  probiems,  such  as  missing  submission  dates.  The  estimates  are 
subject  to  sampiing  error.  The  95-percent  confidence  inten/als  for  the  estimates  are  within  pius  or 
minus  10  percent. 

Note  2:  Lateness  is  measured  by  the  number  of  days  beyond  the  deadiine  (45  days  after  the  ciose  of 
each  previous  quarter)  the  financiai  report  is  submitted  to  OJP. 

Source:  GAO  analysis. 

OJP’s  Office  of  the  Comptroller  also  found  problems  similar  to  those  we 
identified  regarding  financial  reports.  As  mentioned  earlier,  the  Office  of 
the  Comptroller  does  periodic  financial  reviews  of  the  official  grant  file. 

We  examined  Comptroller  records  for  22  grants  also  covered  in  our  review 
and  found  they  identified  8  Byrne  and  9  VAWO  files  that  were  missing 
some  financial  reports  and  5  Byrne  and  8  VAWO  files  in  which  financial 
reports  were  late.  We  did  not  determine  what  was  done  to  follow  up  on  the 
late  or  missing  financial  reports  found  during  these  financial  reviews. 
However,  Comptroller  procedures  call  for  contacting  the  grant  manager  or 
grantee  to  request  copies  of  documents  that  may  be  missing  from  the  file 
and  to  ensure  that  all  documentation  related  to  the  financial  review  is 
included  in  the  official  grant  file  before  the  review  is  closed. 


Byme  and  VAWO  Closeout  Our  review  also  showed  that  BJA  and  VAWO  grant  managers  did  not 
Documents  Missing  always  document  key  closeout  activities  for  those  files  we  examined.  OJP 

requires  that  grants  be  closed  in  a  timely  manner  and  considers  the 
process  to  be  one  of  the  most  important  aspects  of  grant  administration. 
Closing  out  grants  is  the  final  step  in  a  process  by  which  OJP  ensures  that 
all  required  financial  and  progress  reports  and  final  accounting  of  federal 
funds  have  been  received.  The  timeframe  for  completion  of  closeout  is  no 
more  than  180  days  after  the  end  of  the  grant  project.  According  to  OJP 
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guidance,  as  part  of  the  closeout  process,  the  grant  manager  is  to  review 
the  grant  file  and  contact  the  grantee  about  the  upcoming  grant  end  date 
and  final  report  submissions.  The  grant  manager  is  to  use  the  closeout 
checklist  as  a  means  of  ensuring  that  all  closeout  requirements — ^the 
grantee’s  submission  of  final  progress  and  financial  reports — are  met. 

We  identified  19  closed  Byrne  grants  and  3  closed  VAWO  grants  that  ended 
between  September  30,  1999,  and  August  31,  2000.^^  There  were  not 
enough  closed  cases  in  our  sample  to  ensure  that  our  assessment  was 
representative  of  all  grant  closeouts.  However,  our  limited  review  showed 
that  some  grant  files  did  not  contain  required  closeout  materials.  For 
example,  for  the  Byrne  grants: 

•  15  files  did  not  contain  documentation  of  the  precloseout  contact  with  the 
grantee; 

•  9  files  did  not  contain  closeout  checklists; 

•  10  files  did  not  contain  the  final  narrative  progress  report;  and 

•  7  files  did  not  contain  the  final  financial  report. 

For  the  VAWO  grants: 

•  3  files  did  not  contain  documentation  of  the  precloseout  contact  with  the 
grantee; 

•  3  files  did  not  contain  closeout  checklists; 

•  2  files  did  not  contain  the  final  narrative  progress  report;  and 

•  1  file  did  not  contain  the  final  financial  report. 


order  to  take  into  account  the  minimum  180  days  OJP  allows  bureaus  and  offices  to 
complete  closeout  activities,  we  used  August  31,  2000,  as  the  cutoff  date  for  our  analysis  of 
BJA  closeout  activities.  Using  this  cutoff  date,  we  identified  an  additional  2  grants  at  VAWO 
that  appeared  to  be  closed.  However,  according  to  VAWO,  the  2  grants  were  not  actually 
closed,  but  rather,  had  been  given  extensions.  VAWO  officials  acknowledged  that  the 
required  documents  extending  the  grant  period  were  not  in  the  files.  These  grants  were 
excluded  from  our  closed  grant  analysis. 

^^We  did  not  collect  information  for  one  of  the  files  on  precloseout  contacts;  therefore,  this 
part  of  the  review  covered  18,  not  19,  cases. 
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BJA  and  VAWO  Officials 
Acknowledge  Lack  of 
Consistent  Compliance 
With  OJP  Requirements 


BJA  and  VAWO  officials  acknowledged  that  their  file  maintenance  and 
documentation  may  not  have  always  been  in  compliance  with  OJP 
monitoring  requirements.  Officials  at  both  agencies  stated  that,  in  some 
instances,  lack  of  documentation  was  because  of  an  increased  workload 
among  grant  managers.  In  addition,  VAWO  officials  said  that  since  VAWO’s 
inception,  VAWO  grant  managers  have  had  the  responsibility  to  not  only 
monitor  an  increasing  volume  of  grants,  but  also  to  develop  and 
implement  several  new  grant  programs.^*^  In  commenting  on  a  draft  of  this 
report,  the  Assistant  Attorney  General  stated  BJA  grant  managers  have 
had  similar  responsibilities.  The  Assistant  Attorney  General  also 
commented  that  one  reason  for  VAWO’s  lack  of  documentation  regarding 
site  visits  might  be  a  past  practice  by  which  all  VAWO  grant  managers 
memorandums  included  a  standard  monitoring  plan  that  was  developed  in 
fiscal  year  1995,  when  VAWO  was  responsible  for  monitoring  one  formula 
and  one  small  discretionary  grant  program. 


Regardless,  officials  from  both  BJA  and  VAWO  stated  that  the  monitoring 
activities  may  still  be  taking  place,  even  though  they  are  not  documented 
consistently.  When  asked  how  one  would  know  whether  a  desk  review 
had  been  done,  one  BJA  official  told  us  that  desk  reviews  were  not  a 
specific  process,  rather  they  were  the  type  of  activities  that  grant 
managers  did  on  a  day-to-day  basis.  He  added  that  since  BJA  had  no 
formalized  process  for  conducting  desk  reviews,  no  documentation  was 
required  of  the  grant  managers  upon  completion.  Nonetheless,  OJP’s 
guidance  for  the  period  covered  by  our  review  stated  that  a  desk  review 
form  is  to  be  prepared  periodically  to  note,  among  other  things,  all 
contacts,  reports,  and  product  reviews.  The  form  is  also  to  include  issues, 
accomplishments,  and  problems,  noting  recommended  solutions. 


BJA’s  Acting  Director  at  the  time  of  our  review  told  us  that  oversight  of 
grants  can  and  has  suffered  through  changes  at  BJA,  including 
reorganizations  within  BJA  and  the  increased  number  of  grants  and 
greater  workload  for  BJA  grant  managers.  He  said  that  there  is  no  question 
that,  as  mentioned  earlier,  reorganizations  contributed  to  the  difficulty  in 
ensuring  complete  and  accurate  grant  files  and  cited  transfers  of  grant 
files  among  grant  managers  as  one  reason  why  files  were  inaccurate  or 
incomplete.  He  pointed  out  that  BJA  has  made  some  changes,  including 
the  drafting  of  new  policies  and  procedures,  that  are  designed  to  assist 


^^For  example,  the  Higher  Education  Amendments  of  1998  established  the  Grants  to 
Combat  Violence  Crime  Against  Women  on  Campuses  Program  (20  U.S.C.  1152). 


Page  19 


GAO-02-25  Justice  Discretionary  Grants 


grant  managers  in  their  grant  responsibilities.  For  example,  BJA’s  draft 
procedures  called  for  desk  reviews  to  be  performed  by  grant  managers 
every  6  months  or  when  files  were  transferred  among  grant  managers. 
These  reviews  were  to  require  that  each  grant  manager  fill  out  a 
checklist — covering  such  things  as  the  completeness  of  grant  paperwork 
and  the  timeliness  of  progress  and  financial  reports — that  upon 
completion,  was  to  be  reviewed  by  a  branch  chief.  According  to  the  Acting 
Director  at  the  time  of  our  review,  BJA’s  guidance,  which  was  undated, 
had  been  drafted  sometime  before  July  2000,  but  had  since  been  subsumed 
into  OJP’s  January  2001  update  to  its  grant  monitoring  procedures.  At  the 
time  of  our  review,  it  was  unclear  whether  BJA  had  put  any  of  these 
procedures  into  practice.  In  commenting  on  a  draft  of  this  report,  the 
Assistant  Attorney  General  noted  that  BJA  has  indicated  that  it  expects  to 
put  these  procedures  into  practice  in  fiscal  year  2002. 

In  those  same  comments,  the  Assistant  Attorney  General  also  stated  that 
like  BJA,  VAWO  has  been  working  on  developing  policies  and  procedures 
for  monitoring  grantees  more  effectively.  For  example,  she  stated  that  a 
VAWO  Monitoring  Working  Group  was  formed  in  spring  2001.  The  group  is 
working  to  develop  a  risk-based  assessment  tool  to  develop  more  realistic 
monitoring  plans;  pre-,  post-,  and  on-site  protocols  for  site  visits;  a 
standard  site  visit  report  form;  and  a  comprehensive  training  program  on 
monitoring  for  new  employees.  Also,  according  to  the  Assistant  Attorney 
General,  VAWO  has  developed  a  desk  review  checklist  that  will  begin  to  be 
used  in  fiscal  year  2002. 

OJP  requires  documentation  of  grant  monitoring  activities  to  provide 
assurance  to  OJP  grant  managers  and  supervisors  that  appropriate 
oversight  of  grant  activities  is  taking  place.  It  is  possible  that  grant 
managers  are  conducting  grant  monitoring  activities  even  if  no 
documentation  exists.  However,  without  documentation,  neither  OJP, 

BJA,  VAWO,  nor  we  are  positioned  to  tell  with  any  certainty  whether  such 
monitoring  occurred.  The  Comptroller  General’s  internal  control 
standards^^  require  that  all  transactions  and  other  significant  events  be 
clearly  documented  and  that  the  documentation  be  readily  available  for 
examination.  Appropriate  documentation  is  an  internal  control  activity  to 
help  ensure  that  management’s  directives  are  carried  out.  Without  such 
documentation,  OJP,  BJA,  and  VAWO  have  no  assurance  that  grants  are 


Standards  for  Internal  Control  in  the  Federal  Government  (GAO/AIMD-00-2 1.3.1,  Nov. 
1999). 


Page  20 


GAO-02-25  Justice  Discretionary  Grants 


meeting  their  goals  and  funds  are  being  used  properly.  In  addition,  such 
documentation  is  essential  to  systematically  address  grant  performance 
problems. 


BJA  and  VAWO  Are 
Not  Positioned  to 
Systematically 
Determine  Staff 
Compliance  With 
Monitoring 
Requirements  and 
Assess  Overall 
Performance 


BJA  and  VAWO  are  not  positioned  to  systematically  determine  grant 
managers’  compliance  with  monitoring  requirements  because 
documentation  about  monitoring  activities  is  not  readily  available.  BJA 
officials  told  us  that  they  do  not  have  a  management  information  system  to 
collect  and  analyze  data  that  would  help  them  oversee  the  monitoring 
process.  Instead,  they  rely  on  staff  meetings  and  informal  discussions  with 
staff  to  oversee  grant  monitoring  activities  and  identify  potential  grantee 
problems.  As  discussed  earlier,  BJA’s  Acting  Director  at  the  time  of  our 
review  acknowledged  that  BJA  had  experienced  some  documentation 
problems  and  told  us  that,  in  addition  to  drafting  the  aforementioned  BJA 
guidelines,  BJA  had  begun  to  modify  an  officewide  management 
information  system  to  capture  data  on  monitoring  activities.  According  to 
BJA  officials,  the  enhanced  system  is  to  enable  grant  managers  to  enter 
data  on  such  activities  as  site  visits  and  phone  contacts  so  that  they  can  be 
tracked.  However,  at  the  time  of  our  field  work,  the  system  was  still  in 
developmental  stages.  In  commenting  on  a  draft  of  this  report,  the 
Assistant  Attorney  General  stated  that  the  monitoring  portion  of  this 
system  was  deployed  in  October  2001. 

Like  BJA,  VAWO  does  not  have  an  overall  management  information 
system  to  track  monitoring  activities.  VAWO  officials  said  that  they  hold 
weekly  staff  meetings  during  which  they  rely  on  their  grant  managers  to 
proactively  identify  and  discuss  any  grant  problems  or  monitoring  issues.^® 
They  added  that  VAWO  has  developed  a  computerized  site  visit  tracking 
sheet  that  provides  information  about  the  details  of  grant  managers’  on¬ 
site  visits.  A  VAWO  official  said  that  information  reported  in  site  visit 
reports  is  shared  at  staff  meetings  and  is  accessible  to  all  staff  on  VAWO’s 
internal  computer  system.^”  VAWO  officials  also  indicated  that  they  are  in 


commenting  on  a  draft  of  this  report,  the  Assistant  Attorney  General  noted  that  VAWO 
staff  receive  feedback  from  grantees  and  those  receiving  services  from  grantees,  as  well  as 
attend  training  events  in  which  grantees  participate,  all  of  which  assist  VAWO  staff  in 
monitoring  grants. 

^^OJP  uses  site  visit  data  to  compile  an  OJP-wide  report  for  the  Attorney  General.  However, 
according  to  an  official,  OJP  does  not  uniformly  compile  these  data  for  all  types  of  grants 
awarded  by  OJP.  For  example,  whereas  OJP  reports  on  VAWO  site  visits,  it  does  not  report 
on  site  visits  for  BJA  discretionary  grants. 
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the  process  of  developing  a  management  information  system  that  will 
track,  in  addition  to  site  visits,  other  monitoring  activities  such  as  the 
submission  of  progress  and  financial  reports.  However,  like  BJA,  VAWO’s 
system  was  still  in  the  developmental  stages  at  the  time  of  our  review. 

BJA  and  VAWO  also  do  not  appear  to  be  routinely  using  available  OJP- 
wide  data  on  late  progress  and  financial  reports  that  could  help  them 
identify  potential  grantee  documentation  problems.  As  mentioned  earlier, 
the  Office  of  the  Comptroller  has  primary  responsibility  for  carrying  out 
the  monitoring  of  the  fiscal  aspects  of  grants  awarded  by  OJP  bureaus  and 
program  offices,  and  the  Control  Desk  issues  monthly  reports  on  whether 
grantee  progress  and  financial  reports  are  late.  These  reports  are  to  be 
forwarded  to  the  administrative  officers  in  the  bureaus  and  program 
offices.  According  to  OJP’s  Chief  of  Staff  at  the  time  of  our  review,  once 
the  monthly  report  is  distributed,  bureaus  and  program  offices  are 
responsible  for  determining  what  action  to  take  regarding  delinquent 
reports.  BJA  and  VAWO  program  officials  told  us  that  they  were  aware  of 
the  monthly  report,  but  the  Acting  Director  of  VAWO’s  Program 
Management  Division  told  us  that  VAWO  probably  uses  the  report  every 
other  month.  A  BJA  supervisor  indicated  that  he  did  not  receive  the 
reports,  but  he  could  get  it,  as  needed,  from  the  Office  of  the  Comptroller. 

The  lack  of  systematic  data  associated  with  program  monitoring  activities 
and  the  documentation  problems  we  observed  raise  questions  about 
whether  BJA  and  VAWO  are  positioned  to  measure  their  performance 
consistent  with  the  Government  Performance  and  Results  Act  of  1993.  For 
example,  in  its  Fiscal  Year  2000  Performance  Report  and  Fiscal  Year  2002 
Performance  Plan,  DOJ  articulated  a  strategic  goal  to  “prevent  and  reduce 
crime  and  violence  by  assisting  state,  tribal,  local  and  community-based 
programs.”  DOJ’s  performance  report  and  plan  list  various  annual  goals 
and  performance  measures  along  with  performance  data  needed  to  gauge 
performance,  including  three  program  targets  and  performance  measures 
for  VAWO  formula  and  discretionary  grant  programs.  To  gauge  annual 
performance  for  the  three  VAWO  targets,  the  plan  and  report  state  that 
needed  performance  data 

•  will  be  obtained  from  grantee  progress  reports,  on-site  monitoring,  and 
VAWO  program  office  files; 

•  will  be  verified  and  validated  through  a  review  of  grantee  progress  reports, 
telephone  contacts  with  grantees,  and  on-site  monitoring  of  grantee 
performance  by  grant  program  managers;  and 

•  contain  no  known  limitations. 
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Although  the  DOJ  performance  report  and  plan  state  that  there  are  no 
known  data  limitations,  inconsistent  documentation  and  the  lack  of 
systematic  data  could  be  a  serious  limitation  that  hinders  VAWO’s  ability 
to  measure  whether  it  is  achieving  its  goals.  VAWO  officials  told  us  that 
they  are  not  satisfied  with  the  current  performance  measures  because  they 
do  not  believe  they  are  meaningful  for  measuring  program  outcomes.  They 
said  that  they  have  begun  to  work  with  OJP’s  Office  of  Budget  and 
Management  Services  and  an  outside  contractor  to  develop  new  measures. 
They  added  that  their  goal  is  to  have  these  new  measures  available  for  the 
fiscal  year  2003  GPRA  performance  plan. 

OJP’s  Efforts  to 
Resolve  Continuing 
Grant  Monitoring 
Problems 

Over  the  last  few  years,  we  and  others,  including  OJP,  have  identified 
various  grant  monitoring  problems  among  OJP’s  bureaus  and  offices.  OJP 
has  begun  to  work  with  its  bureaus  and  offices,  such  as  BJA  and  VAWO,  to 
address  these  problems,  but  it  is  too  early  to  tell  whether  its  efforts  will  be 
enough  to  resolve  many  of  the  issues  that  we  and  others,  including  OJP, 
have  identified. 

Problems  With  OJP  Grant 
Monitoring  Are  Not  New 

Since  1996,  we  have  testified  and  issued  reports  that  document  grant 
monitoring  problems  among  some  of  OJP  bureaus  and  offices.  In  1996,  we 
testified  on  the  operations  of  the  Office  of  Juvenile  Justice  and 

Delinquency  Prevention.^"  We  found  that  almost  all  of  the  official 
discretionary  grant  files  we  reviewed  contained  monitoring  plans,  but 
there  was  little  evidence  that  monitoring  had  occurred.  More  recently,  in 
an  October  2001  report,  we  observed  many  of  the  same  issues  concerning 
OJJDP’s  lack  of  documentation  of  its  monitoring  activities."^  Also,  in  1999, 
we  issued  a  report  that,  among  other  things,  addressed  how  OJP’s 
Executive  Office  for  Weed  and  Seed  monitors  local  Weed  and  Seed  sites  to 
ensure  that  grant  requirements  are  met.""  We  found  that,  during  fiscal  year 
1998,  grantees  had  not  submitted  all  of  the  required  progress  reports  and 
grant  managers  had  not  always  documented  the  results  of  their  on-site 
monitoring  visits. 

^Juvenile  Justice:  Selected  Issues  Relating  to  OJJDP’s  Reauthorization 
fGAO/T-GGD-96-103,  May  8,  1996). 

"^GAO-02-65. 

^^Federal  Grants:  More  Can  Be  Done  to  Improve  Weed  and  Seed  Program  Management 
(GAO/GGD-99-110,  July  16,  1999). 
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OJP  has  also  identified  problems  with  grant  monitoring.  In  1996,  an  OJP- 
wide  working  group,  established  at  the  request  of  the  Assistant  Attorney 
General,  issued  a  report  on  various  aspects  of  the  grant  process,  including 
grant  administration  and  monitoring.  Among  other  things,  the  working 
group  found  that 

•  the  administration  of  grants,  including  monitoring,  was  not  standardized 
within  OJP; 

•  given  the  monitoring  resources  available,  monitoring  plans  were  overly 
ambitious,  the  usual  result  being  failure  to  attain  the  level  of  monitoring 
indicated  in  the  plans;  and 

•  an  OJP-wide  monitoring  tracking  system  was  needed  to  document  all 
monitoring  activities  on  an  individual  grant  and  facilitate  control  of  the 
monitoring  process. 

The  working  group  recommended  that  OJP  establish  another  working 
group  to  develop  detailed  operating  procedures,  giving  special  attention  to 
the  issue  of  grant  monitoring. 

Almost  4  years  later,  in  February  2000,  Dougherty  and  Associates,  under 
contract,  delivered  a  report  to  OJP  containing  similar  fmdings.^^  The  report 
stated  that  that  OJP  lacks  consistent  procedures  and  practices  for 
performing  grant  management  functions,  including  grant  monitoring, 
across  the  agency.  For  example,  according  to  the  report,  no  formal 
guidance  had  been  provided  to  grant  managers  on  how  stringent  or 
flexible  they  should  be  with  grantees  in  enforcing  deadlines,  due  dates, 
and  other  grant  requirements.  Also,  the  report  stated  that  the  official  grant 
files  were  often  not  complete  or  reliable.  To  improve  grant  monitoring,  the 
contractor  recommended,  among  other  things,  that  OJP  develop  an 
agencywide,  coordinated  and  integrated  monitoring  strategy;  standardize 
guidelines  and  procedures  for  conducting  site-visits,  product  reviews,  and 
other  monitoring  activities;  and  mandate  the  timeliness  and  filing  of 
monitoring  reports. 

The  DOJ’s  Office  of  Inspector  General  has  also  identified  and  reported  on 
OJP-wide  grant  management  and  monitoring  problems.  For  example,  in 
December  2000,  the  Inspector  General  identified  grant  management  as  one 
of  the  10  major  management  challenges  facing  DOJ.  The  Inspector  General 


Final  Report  of  Findings  &  Recommendations  for  Improvement  of  the  Grant 
Management  Process  (Alexandria,  VA:  Dougherty  and  Associates,  Feb.  2000). 
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stated  that  DOJ’s  multibillion-dollar  grant  programs  are  a  high  risk  for 
fraud,  given  the  amount  of  money  involved  and  the  tens  of  thousands  of 
grantees.  Among  other  things,  the  Inspector  General  said  that  past  reviews 
determined  that  many  grantees  did  not  submit  the  required  progress  and 
financial  reports  and  that  program  officials’  on-site  monitoring  reviews  did 
not  consistently  address  all  grant  conditions. 


Too  Early  to  Gauge 
Effectiveness  of  OJP’s 
Efforts  to  Resolve  Grant 
Monitoring  Problems 


OJP  has  begun  to  work  with  bureaus  and  offices  to  resolve  some  of  the 
problems  it  and  others  have  identified,  but  it  is  much  too  early  to  tell  how 
effective  these  efforts  will  be  in  resolving  these  issues.  In  its  Fiscal  Year 
2000  Performance  Report  and  Fiscal  Year  2002  Performance  Plan 
developed  under  GPRA,  OJP  established  a  goal  to  achieve  the  effective 
management  of  grants.  Among  other  things,  DOJ  plans  to  achieve  this  goal 
by  continued  progress  toward  full  implementation  of  a  new  Grant 
Management  System  as  a  way  of  standardizing  and  streamlining  the  grant 
process.  According  to  the  performance  report  and  performance  plan,  GMS 
will  assist  OJP  in  setting  priorities  for  program  monitoring  and  facilitate 
timely  program  and  financial  reports  from  grantees. 


OJP’s  Chief  of  Staff  at  the  time  of  our  review  told  us  that,  in  his  view,  the 
only  way  to  ensure  that  staff  consistently  document  their  monitoring 
activities  is  to  require  grant  managers  to  enter  information  about  their 
monitoring  activities,  when  they  occur,  into  an  automated  system,  like 
GMS.  He  said  that  currently,  OJP  runs  the  risk  of  losing  or  misplacing  key 
documentation,  especially  since  documents  are  kept  in  two  files  physically 
maintained  by  two  organizations  in  different  locations — one,  the  official 
file  maintained  by  the  Office  of  the  Comptroller,  and  the  other,  the  grant 
manager’s  file  maintained  by  the  program  office.  He  said  that  the  new 
system  currently  covers  grants  for  some  OJP  organizations  up  to  the 
award  stage,  but  that  OJP’s  goal  is  to  include  tracking  information  about 
all  stages  of  the  grant  process  from  preaward  through  closeout.^'' 


Although  GMS  may  ultimately  help  OJP  better  manage  the  grant 
administration  process,  DOJ’s  Fiscal  Year  2000  Performance  Report  and 
Fiscal  Year  2002  Performance  Plan  does  not  state  when  GMS  will  be 
expanded — either  to  all  of  the  OJP  components  or  to  include  the  full  range 
and  scope  of  monitoring  activities.  Regarding  the  latter,  OJP’s  Director  of 
Office  of  Budget  and  Management  Services  indicated  that  it  is  unlikely  that 


Appendix  II  illustrates  the  stages  of  the  grant  process. 
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GMS  will  cover  the  full  range  of  monitoring  activities;  instead,  OJP  would 
be  more  likely  to  develop  a  monitoring  management  information  system  to 
capture  monitoring  data  that  would  link  to  GMS.^^  The  Director  said  that 
OJP  has  formed  an  OJP-wide  working  group  to  further  study  data  issues 
related  to  monitoring  activities,  but  the  group  is  in  its  preliminary  stages 
and  has  yet  to  develop  a  charter  to  define  its  activities. 

OJP  has  also  been  working  on  two  key  efforts  to  enhance  its  ability  to 
better  control  grant  administration.  One  of  these  initiatives,  “Operation 
Closeout,”  was  a  pilot  project  announced  in  February  2000  by  OJP’s 
Working  Group  on  Grant  Administration  that  was  to,  among  other  things, 
accelerate  the  grant  closeout  process  through  revised  closeout  guidelines 
and  elevate  the  importance  of  the  closeout  function  as  a  required 
procedure  in  the  administration  of  grants.^*^  In  November  2000,  the  working 
group  announced  that  it  had  realized  several  of  the  Operation’s  objectives 
and,  working  with  the  Office  of  the  Comptroller,  was  able  to  reduce  the 
backlog  of  grants,  including  some  managed  by  BJA  and  VAWO,  that  were 
eligible  to  be  closed  but  had  not  been  closed.  According  to  the  Chairman 
of  the  working  group,  this  operation  closed  out  4,136  outstanding  grants 
over  a  6-month  period,  resulting  in  over  $30  million  in  deobligated  funds. 

In  September  2001,  the  Chairman  said  that  OJP  was  going  to  initiate 
another  closeout  operation  based  on  the  success  of  the  pilot. 

Another  OJP  initiative  involved  the  development  and  issuance  of  new  OJP- 
wide  guidance  for  grant  administration,  including  grant  monitoring.  As 
mentioned  earlier,  in  January  2001,  OJP  released  Grant  Management 
Policies  and  Procedures  Manual  to  update  and  codify  OJP’s  current 
policies  and  procedures  regarding  its  business  practices.^^  According  to 
OJP  officials,  the  new  guidance  was  developed  at  the  direction  of  the 
former  Assistant  Attorney  General  to  address  overall  concerns  about 
weaknesses  in  the  1992  version.  The  guidance  was  developed  over  a 
period  of  about  two  years,  with  the  goal  of  reengineering  the  grant 
management  process  based  on  the  best  practices  of  bureaus  and  offices 
throughout  OJP.  For  example,  the  changes  include  some  provisions 
pertaining  to  some  of  the  aforementioned  closeout  activities-grantees  are 


commenting  on  a  draft  of  this  report,  the  Assistant  Attorney  General  noted  that  the 
Office  of  the  Comptroller  already  utilizes  a  financial  monitoring  tracking  system  to  manage 
financial  monitoring  activities  and  capture  financial  monitoring  information. 

^^The  working  group  was  comprised  of  staff  members  from  OJP’s  bureaus  and  offices. 

^'^This  document  superseded  the  1992  Handbook. 
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Conclusions 


now  given  120  days  to  submit  final  financial  reports  (instead  of  90  days). 
Also,  grant  managers  are  given  greater  latitude  to  close  out  a  grant  if  they 
have  been  unsuccessful  in  obtaining  the  final  financial  report  from  the 
grantee. 

OJP  trained  over  300  grant  managers  during  summer  2001  and,  according 
to  the  Chairman  of  the  working  group,  intends  to  train  supervisors  about 
the  new  guidance  in  fall  2001.  OJP  also  has  drafted  and  plans  to  send  a 
questionnaire  to  recently  trained  grant  managers  to  identify  any  issues  or 
problems  with  using  the  online  manual  and  to  identify  potential  training 
interest  and  topics.  OJP  plans  to  develop  and  send  a  similar  questionnaire 
to  supervisors  once  they  are  trained.  However,  the  Chairman  indicated 
that  there  are  no  plans  to  test  or  systematically  monitor  compliance  with 
the  new  guidelines  to  ensure  that  grant  managers  are  fulfilling  their 
responsibilities.  He  said  that  OJP  had  not  contemplated  testing  or 
systematic  monitoring  because  of  other  initiatives  currently  under  way. 


Because  BJA  and  VAWO  discretionary  grant  files  were  insufficiently 
documented  neither  OJP,  BJA,  VAWO,  or  we  can  determine  the  level  of 
monitoring  being  performed  by  grant  managers  as  required  by  OJP  and  the 
Comptroller  General’s  internal  control  standards.  BJA  and  VAWO 
supervisors  rely  on  staff  meetings  and  discussions  with  staff  to  alert  them 
to  grantee  problems  or  grant  monitoring  issues,  but  these  activities  are  not 
sufficient  to  ensure  that  required  monitoring  is  taking  place  or  that  the 
proper  documentation  is  occurring.  Furthermore,  BJA  and  VAWO  do  not 
have  readily  available  data  on  most  monitoring  activities  that  would  help 
them  determine  grant  managers’  compliance  with  OJP  guidelines,  and 
even  when  data  are  available,  it  is  not  clear  that  supervisors  use  the  data 
to  ensure  that  monitoring  activities  occurred.  The  lack  of  systematic  data, 
combined  with  poor  documentation,  limits  BJA  and  VAWO’s  ability  to 
manage  the  grant  monitoring  process  so  that  they  can  determine  whether 
grant  managers  are  monitoring  grantees,  and  if  not,  why  not,  or  if  so,  why 
are  they  not  documenting  their  activities.  It  also  hinders  BJA  and  VAWO’s 
ability  to  measure  their  performance  consistent  with  GPRA,  especially 
given  that  DOJ  is  relying  on  data  collected  through  grant  monitoring  to 
measure  the  Department’s  performance  for  many  of  its  grant  programs. 
Furthermore,  it  places  BJA  and  VAWO  at  risk  in  ensuring  that  the  millions 
of  dollars  in  discretionary  grant  funds  that  they  distribute  are  effectively 
and  responsibly  managed. 

Grant  monitoring  problems  have  been  long-standing  at  DOJ,  and  although 
OJP  has  taken  steps  intended  to  resolve  some  of  them,  it  is  too  early  to  tell 
whether  these  steps  will  effectively  solve  the  types  of  documentation 
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problems  that  we  and  others  have  identified.  Automation  of  the  grant 
management  process,  particularly  in  regard  to  grant  monitoring,  holds 
some  promise  if  OJP  takes  steps  to  ensure  that  all  monitoring  activities  are 
consistently  recorded  and  maintained  in  a  timely  manner.  However, 
current  and  future  efforts  will  be  futile  unless  OJP  and  its  bureaus  and 
offices,  such  as  BJA  and  VAWO,  periodically  test  grant  manager 
compliance  with  OJP  requirements  and  take  corrective  actions  to  enforce 
those  requirements. 


RorommorKifitioriS  for  facilitate  and  improve  the  management  of  program  monitoring,  we 

recommend  that  the  Attorney  General  direct  BJA  and  VAWO  to  review 
Executive  Action  whether  the  documentation  problems  we  identified  were  an  indication  of 

grant  monitoring  requirements  not  being  met  or  of  a  failure  to  document 
activities  that  did,  in  fact,  take  place.  If  monitoring  requirements  are  not 
being  met,  we  recommend  that  the  Attorney  General  direct  BJA  and 
VAWO  to  determine  why  this  is  so  and  to  take  into  account  those  reasons 
as  they  consider  solutions  for  improving  compliance  with  the 
requirements.  If  it  is  determined  that  required  monitoring  is  taking  place 
but  is  not  being  documented,  we  recommend  that  the  Attorney  General 
take  steps  to  direct  BJA  and  VAWO  to  periodically  articulate  and  enforce 
clear  expectations  regarding  documentation  of  monitoring  activities. 

We  also  recommend  that  the  Attorney  General  direct  OJP  to  study  and 
recommend  ways  to  establish  an  OJP-wide  approach  for  systematically 
testing  or  reviewing  official  and  program  files  to  ensure  that  the  grant 
managers  in  its  various  bureaus  and  offices  are  consistently  documenting 
their  monitoring  activities  in  accordance  with  OJP  requirements  and  the 
Comptroller  General’s  internal  control  standards.  Furthermore,  we 
recommend  that  the  Attorney  General  direct  OJP  to  explore  ways  to 
electronically  compile  and  maintain  documentation  of  monitoring 
activities  to  facilitate  (1)  more  consistent  documentation  among  grant 
managers;  (2)  more  accessible  oversight  by  bureau  and  program  office 
managers;  and  (3)  sound  performance  measurement,  consistent  with 
GPRA. 


Agency  Comments 
and  Our  Evaluation 


We  provided  a  copy  of  a  draft  of  this  report  to  the  Attorney  General  for 
review  and  comment.  In  a  November  9,  2001,  letter,  the  Assistant  Attorney 
General  commented  on  the  draft.  Her  comments  are  summarized  below 
and  presented  in  their  entirety  in  appendix  111. 

The  Assistant  Attorney  General  said  that  overall,  the  report  provides 
useful  information  in  highlighting  management  and  monitoring  activities  in 
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need  of  improvement.  She  noted  that  BJA  and  VAWO  have  already  taken 
steps  to  address  the  recommendations  for  follow-up  action  included  in  the 
draft  report.  For  example,  the  Assistant  Attorney  General  said  that  BJA 
has  taken  steps  to,  among  other  things,  expand  its  grants  tracking  system 
to  include  tracking  of  staff  and  grantee  contacts  and  instituted  a  policy 
that  a  desk  review  be  conducted  twice  per  year  for  all  grants.  With  regard 
to  VAWO,  the  Assistant  Attorney  General  said  that,  among  other  things, 
VAWO  had  established  a  monitoring  working  group  tasked  with 
developing  monitoring  policies  and  procedures  for  monitoring  grantees 
more  effectively,  including  more  realistic  monitoring  plans  and  a 
standardized  site  visit  reporting  format. 

We  acknowledge  that  BJA  and  VAWO  appear  to  be  taking  steps  in  the  right 
direction  toward  resolving  some  of  the  issues  we  identified.  However, 
until  these  actions  become  operational,  BJA  and  VAWO  will  not  be  able  to 
determine  whether  the  problems  we  identified  constitute  either  a  failure  to 
carry  out  required  monitoring  activities  or  a  failure  to  document 
monitoring  activities.  Once  BJA  and  VAWO  make  this  determination,  they 
will  be  better  positioned  to  consider  what  additional  steps  need  to  be 
taken,  such  as  articulating  and  enforcing  clear  expectations  regarding  the 
documentation  of  monitoring  activities. 

In  her  letter,  the  Assistant  Attorney  General  did  not  address  our 
recommendations  that  OJP  (1)  study  and  recommend  ways  to  establish  an 
OJP-wide  approach  for  systematically  testing  or  reviewing  official  and 
program  grant  files  or  (2)  explore  ways  to  electronically  compile  and 
maintain  documentation  of  monitoring  activities.  Although  the  steps  BJA 
and  VAWO  are  taking  may  help  them  better  understand  and  act  upon 
problems  associated  with  the  documentation  of  monitoring  activities,  the 
steps  discussed  in  the  Assistant  Attorney  General’s  letter  appear  to  be 
actions  specific  to  those  organizations.  Thus,  it  is  unclear  whether  and  to 
what  extent  those  actions  can  be  applied  throughout  OJP.  Without  a  more 
focused  and  concerted  effort  to  implement  an  OJP-wide  approach  for 
systematically  testing  or  reviewing  program  grant  files  and  an  automated 
approach  to  compile  and  document  monitoring  data,  OJP  could  continue 
to  face  the  grant  monitoring  problems  we  and  others,  including  OJP,  have 
identified. 

In  addition  to  the  above  comments,  the  Assistant  Attorney  General  made  a 
number  of  suggestions  related  to  topics  in  this  report.  We  have  included 
the  Assistant  Attorney  General's  suggestions  in  the  report,  where 
appropriate.  Also,  the  Assistant  Attorney  General  provided  other 
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comments  for  which  we  did  not  make  changes.  See  appendix  III  for  a 
more  detailed  discussion  of  the  Assistant  Attorney  General's  comments. 


We  are  sending  copies  of  this  report  to  the  Chairmen  of  the  Senate 
Judiciary  Committee  and  its  Subcommittee  on  Youth  Violence;  Chairmen 
and  Ranking  Minority  Members  of  the  House  Committee  on  Education  and 
the  Workforce;  Attorney  General;  OJP  Assistant  Attorney  General;  BJA 
Administrator;  VAWO  Administrator;  and  Director,  Office  of  Management 
and  Budget.  We  will  also  make  copies  available  to  others  on  request. 

If  you  or  your  staff  have  any  questions  about  this  report,  please  contact 
John  F.  Mortin  or  me  at  (202)  512-8777.  Key  contributors  to  this  report  are 
acknowledged  in  appendix  IV. 


Laurie  E.  Ekstrand 
Director,  Justice  Issues 
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Appendix  I:  Size  and  Growth  of  OJP,  BJA,  and 
VAWO  Budgets  and  BJA  and  VAWO 
Discretionary  Grant  Programs 


The  Office  of  Justice  Programs  (OJP)  and  its  bureaus  and  offices, 
including  the  Bureau  of  Justice  Assistance  (BJA)  and  the  Violence  Against 
Women  Office  (VAWO),  experienced  budget  growth  in  the  latter  half  of  the 
1990s,  following  the  passage  of  the  1994  Crime  Act  J  According  to  data  we 
obtained  from  OJP,  in  the  1990s,  the  yearly  number  of  BJA  discretionary 
awards  and  total  dollar  amount  of  those  awards  fluctuated  somewhat,  but 
generally  increased.  The  number  of  Byrne  discretionary  grant  awards  have 
decreased  since  a  high  point  in  fiscal  year  1994;  however,  the  total  yearly 
dollar  amount  has  increased  overall.  Furthermore,  while  the  yearly 
number  of  Byrne  awards  and  the  dollar  amount  of  those  awards  generally 
increased,  there  were  some  yearly  decreases.  Following  the  creation  of 
VAWO  in  1995,  the  yearly  number  of  discretionary  awards  and  total  dollar 
amount  of  those  awards  increased  overall. 


Budget  Increases  at 
OJP,  BJA,  and  VAWO 
in  the  1990s 


According  to  OJP  data,  from  1990  through  2000,  OJP’s  budget  grew,  in 
constant  fiscal  year  2000  dollars,  by  323  percent,  from  about  $916  million 
in  fiscal  year  1990  to  nearly  $3.9  billion  in  fiscal  year  2000.^  Our  analysis  of 
the  OJP  data  also  showed  that  BJA’s  budget  grew  during  the  1990s,  but  to 
a  lesser  extent  than  OJP’s.  BJA’s  budget  increased  by  173  percent,  from 
about  $618  million  in  fiscal  year  1990  to  nearly  $1.7  billion  in  fiscal  year 
2000.  In  fiscal  year  1996,  OJP  and  BJA’s  budget  increased  sharply  after 
enactment  of  the  1994  Crime  Act.  BJA’s  budget  as  a  percentage  of  OJP’s 
budget  decreased  from  about  67  percent  in  fiscal  year  1990  to  57  percent 
in  fiscal  year  1996.  Following  its  creation  in  1995,  VAWO’s  budget 
increased  by  42  percent,  from  $176  million  in  fiscal  year  1996,  its  first  full 
year  of  funding,  to  about  $250  million  in  fiscal  year  2000.  ^  Figure  2  shows 
the  growth  in  overall  OJP,  BJA,  and  VAWO  budgets,  illustrating  how  BJA 
and  VAWO  fit  into  the  overall  OJP  budget  from  fiscal  years  1990  through 
2000. 


Aiolent  Crime  Control  and  Law  Enforcement  Act  of  1994  (P.L.  103-322). 

^All  budget  figures  in  this  appendix,  unless  otherwise  noted,  are  adjusted  to  constant  fiscal 
year  2000  dollars. 

AaWO  was  first  funded  under  the  Violence  Against  Women  Act  of  1994,  Title  IV  of  the 
Crime  Act  (P-L.  103-322). 
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Figure  2:  Overall  OJP  and  BJA  and  VAWO  Yearly  Budget  Resources 
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4,000,000 


Fiscal  Year 

I  I  Other  OJP  Bureaus  and  Oftices  Resources 

I  I  BJA  Resources 
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Note1 :  According  to  OJP  budget  officials,  yearly  figures  include  all  funds  appropriated  to  OJP, 
transfers  from  other  agencies,  and  receipts  from  the  Crime  Victim  Fund,  which  is  derived  not  from  tax 
dollars,  but  from  fines  and  penalties  paid  by  federal  criminal  offenders.  However,  the  yearly  figures  do 
not  include  grants  awarded  and  administered  by  OJP  bureaus  and  offices  for  other  federal  agencies 
(including  other  DOJ  agencies)  under  reimbursable  agreements.  Also,  the  yearly  amounts  do  not 
include  direct  appropriations  for  OJP  management  and  administration.  The  large  funding  increase  for 
fiscal  year  1996  resulted  from  the  Omnibus  Consolidated  Recissions  and  Appropriations  Act  of  1996, 
which  appropriated  funds  authorized  by  the  Violent  Crime  Control  and  Law  Enforcement  Act  of  1994. 

Note  2:  The  budget  amounts  for  each  fiscal  year  are  adjusted  to  constant  fiscal  year  2000  dollars. 

Source:  OJP  Office  of  Budget  and  Management  Services. 


Discretionary  Grant 
Award  Increases  at 
BJA  and  VAWO  in  the 
1990s 


For  this  report,  we  analyzed  the  growth  in  the  number  and  dollar  amount 
of  discretionary  awards  each  year  by  BJA  and  VAWO  from  1990  through 
2000,  based  on  data  provided  by  OJP.  From  1990  to  2000,  the  number  of 
BJA  Byrne  discretionary  awards  increased  by  about  83  percent — from  54 
in  fiscal  year  1990  to  99  in  fiscal  year  2000.  Overall,  the  total  number  of 
BJA  discretionary  awards,  including  Byrne  discretionary  awards, 
increased  by  about  320  percent — from  65  in  fiscal  year  1990  to  273  in  fiscal 
year  2000.  As  shown  in  figure  3,  the  overall  increase  in  BJA  discretionary 
awards  for  the  11-year  period  we  analyzed  was  moderate,  with  some 
yearly  decreases. 
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Figure  3:  Overall  Yearly  BJA  Discretionary  Awards 
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I  I  Byrne  Discretionary  Awards 

Source:  OJP  Office  of  the  Comptroller. 

Along  with  the  increased  number  of  discretionary  awards  by  BJA,  the 
yearly  total  dollar  amount  of  those  awards  also  increased.  As  illustrated  in 
figure  4  below,  the  total  dollar  amount  of  Byrne  discretionary  awards 
increased,  in  constant  fiscal  year  2000  dollars,  by  256  percent — from  about 
$19  million  in  fiscal  year  1990  to  almost  $69  million  in  fiscal  year  2000.  The 
total  dollar  amount  of  all  BJA  discretionary  awards,  including  Byrne 
discretionary  awards,  increased  even  more — by  about  422  percent — from 
just  over  $36  million  in  fiscal  year  1990  to  nearly  $189  million  in  fiscal  year 
2000.  The  increase  in  the  yearly  total  dollar  amount  of  Byrne  discretionary 
awards  was  moderate,  with  some  yearly  decreases.  For  all  BJA 
discretionary  awards,  particularly  non-Byrne  discretionary  awards,  the 
total  dollar  amount  increases  were  substantial  in  fiscal  years  1998  through 
2000.  Figure  4  shows  the  dollar  amount  of  BJA  discretionary  awards 
(Byrne  and  non-Byme)  from  fiscal  year  1990  to  2000. 
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Figure  4:  Dollar  Amount  of  Overall  BJA  Discretionary  Awards 
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Note:  The  award  amounts  for  each  fiscal  year  are  adjusfed  fo  constant  fiscal  year  2000  dollars. 
Source:  OJP  Office  of  the  Comptroller. 

Data  provided  by  OJP  showed  that  at  VAWO,  since  its  inception  in  1995, 
the  yearly  total  number  and  dollar  amount  of  its  discretionary  awards  also 
increased.  As  shown  in  the  figures  below,  the  yearly  number  of  VAWO 
discretionary  awards  increased  by  about  362  percent — from  92  in  fiscal 
year  1996,  the  first  full  year  of  funding  to  425  in  fiscal  year  2000.  In 
addition,  the  yearly  dollar  amount  of  VAWO  discretionary  awards 
increased  by  about  940  percent — from  just  over  $12  million  in  fiscal  year 
1996,  the  first  full  year  of  funding,  to  about  $125  million  in  fiscal  year  2000. 

Figure  5  shows  the  number  of  VAWO  discretionary  awards  for  each  fiscal 
year  from  1995  to  2000.  Figure  6  shows  the  dollar  amount  of  VAWO 
discretionary  awards  for  the  same  period. 
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Figure  5:  Number  of  Yearly  VAWO  Discretionary  Awards 
450  Number  of  Awards 


1995  1996  1997  1998  1999  2000 

Fiscal  Year 


Source:  OJP  Office  of  the  Comptroller. 

Figure  6:  Dollar  Amount  of  VAWO  Discretionary  Awards 
140,000,000  Dollars 


Fiscal  Year 

Note:  The  award  amounts  for  each  fiscal  year  are  adjusted  to  constant  fiscal  year  2000  dollars. 
Source:  OJP  Office  of  the  Comptroller. 
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OJP  awards  two  types  of  grants:  formula  and  discretionary.  OJP  formula 
grants  are  awarded  directly  to  state  governments,  which  then  make 
subawards  to  state  and  local  unites  of  government.  Discretionary  grants 
can  be  awarded  to  states,  local  units  of  government,  Indian  tribes  and 
tribal  organizations,  individuals,  educational  institutions,  private  nonprofit 
organizations,  and  private  commercial  organizations.  With  some 
discretionary  grant  programs,  OJP  has  some  flexibility  in  selecting  topics 
as  well  as  grantees.  Some  discretionary  awards  are  competitive,  while 
others  are  non-competitive,  owing  to  limited  amount  of  fimds  available  to 
a  limited  number  of  potential  recipients.  Figure  7  summarizes  the  life  of  a 
discretionary  grant  from  application  to  closeout. 


Figure  7:  Life  of  a  Discretionary  Grant 
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Once  the  application  for  the  discretionary  grant  is  accepted,  OJP  guidance 
requires  the  grant  manager  to  prepare  a  grant  manager’s  memorandum, 
which  OJP  reviews  before  the  award  is  made.  The  memorandum  is  to 
consist  of  the  following,  among  other  things: 

•  an  overview  of  the  project; 

•  a  detailed  description  of  what  type  of  activities  the  grantee  plans  to 
implement; 

•  a  discussion  of  the  financial  justification  of  the  grant  funds  and  of  the  cost- 
effectiveness  evaluation  of  the  application;  and 

•  a  discussion  of  past  assessments,  where  applicable. 
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As  part  of  a  grant  manager’s  memorandum,  each  grant  manager  is  to 
prepare  a  monitoring  plan.  The  plan  is  to  contain  information  on  who  will 
conduct  the  monitoring,  how  it  will  be  done,  and  when  and  what  type  of 
monitoring  activities  are  planned.  Monitoring  information  is  to  be 
collected  using  such  techniques  as  on-site  visits,  telephone  calls,  and  desk 
reviews,  which  are  reviews  to  ensure  that  the  grant  files  are  complete  and 
that  the  grantee  is  in  compliance  with  the  program  guidelines.  Also,  OJP 
guidance  requires  the  grantee  to  file  specific  reports  with  the  Office  of  the 
Comptroller:  semiannual  progress  reports  that  summarize  project 
activities  and  quarterly  financial  reports  that  provide  an  accounting  of 
grant  expenditures.  The  Office  of  the  Comptroller  is  to  forward  the  reports 
to  grant  managers. 

OJP  is  to  apply  the  same  process  to  supplemental  awards  as  it  does  to  the 
original  award  of  a  grant.  When  the  grantee  requests  an  extension,  thus 
requiring  supplemental  funding,  the  grantee  must  repeat  the  award 
application  process,  and  more  time  and  money  is  expended. 

At  the  end  of  the  grant  period,  the  grant  manager  is  required  to  close  out 
the  grant  according  to  OJP  guidance.  Closing  out  grants  is  the  final  step  in 
a  process  by  which  OJP  ensures  that  all  required  financial  and  progress 
reports  and  a  final  accounting  of  federal  funds  have  been  received.  Figure 
8  illustrates  the  grant  process,  including  supplemental  or  extended 
funding. 
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Figure  8:  Supplemental  Award  Process  and  Time  Frame 
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Note:  GAO  comments 
supplementing  those  in 
the  report  text  appear  at 
the  end  of  this  appendix. 


U.S.  Department  of  Justice 

Office  of  Justice  Programs 


Office  of  the  Assistant  Attorney  General  Washington,  D.C.  20531 


Laurie  E.  Ekstrand 
Director,  Justice  Issues 
Tax  Administration  and  Justice 
General  Accounting  Office 
441  G  Street,  N.W.  Room  2A38 
Washington,  D.C.  20548 

Dear  Ms.  Ekstrand: 

This  correspondence  responds  to  the  General  Accounting  Office  (GAO)  draft  report  entitled 
"JUSTICE  DISCRETIONARY  GRANTS:  Byrne  and  Violence  Against  Women  Office  Grant 
Monitoring  Should  Be  Better  Documented"  (GAO-02-25).  The  draft  report  has  been  reviewed  by 
the  Office  of  Justice  Programs’  (OJP’s)  Bureau  of  Justice  Assistance  (BJA)  and  Violence 
Against  Women  Office  (VAWO). 

Overall,  the  report  provides  useful  information  in  highlighting  management  and  monitoring 
activities  in  need  of  improvement.  The  BJA  and  VAWO  have  already  taken  steps  to  address  the 
recommendations  for  follow-up  action  included  in  the  draft  report.  Specifically,  for  discretionary 
grants,  BJA: 

•  expanded  their  grants  tracking  system  to  include  tracking  of  staff/grantee  contacts 
including  site  visits,  desk  reviews  and  phone  contacts,  as  well  as  grant  adjustment  notices 
and  closeouts; 

•  developed  and  implemented  a  grant-specific  criteria  rating  scheme  as  a  means  to 
determine  which  grantees  need  on-site  visits;  as  a  result,  there  is  a  division-wide 
monitoring  plan  for  2002; 

•  instituted  a  policy  that  a  desk  review  be  conducted  twice  per  year  for  all  grants; 

•  drafted  new  policies  and  procedures  for  on-site  monitoring,  and 

•  developed  more  specific  guidance  for  grantees  on  completing  progress  reports  to  ensure 
more  specific  performance  data  is  obtained. 

Specifically,  VAWO: 

•  in  the  Spring  of  2001,  formed  a  monitoring  working  group  that  is  tasked  with  developing 
policies  and  procedures  for  monitoring  grantees  more  effectively.  Currently,  the  working 
group  is  developing  a  risk-based  assessment  tool  to  develop:  1)  more  realistic  monitoring 
plans;  2)  pre-,  post-,  and  on-site  protocols  for  site  visits;  3)  a  standard  site  visit  report 
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format;  and  4)  a  comprehensive  training  program  on  monitoring  for  new  employees. 

•  began  using  a  Desk  Review  Checklist  in  Fiscal  Year  (FY)  2002  for  in-house 
programmatic  monitoring  of  grants;  and 

•  developed  a  management  information  system  that  will  eventually  track  the  submission  of 
progress  and  financial  status  reports  to  allow  for  follow-up  with  grantees  who  are 
delinquent. 

Our  detailed  comments  are  enclosed  for  your  consideration.  If  you  have  any  questions  or  need 
additional  information  about  this  response,  please  contact  me  on  (202)  307-5933  or  LeToya 
Bryant,  OJP  Audit  Liaison,  on  (202)  514-0692.  Thank  you  for  your  continued  cooperation  and 
assistance. 

Sincerely, 

Deborah  J.  Daniels 
Assistant  Attorney  General 

Enclosure 

cc :  Richard  N  edelkoff 

Director 

Bureau  of  Justice  Assistance 

Diane  Stuart 
Director 

Violence  Against  Women  Office 


Cynthia  J.  Schwimer 
Comptroller 

Office  of  Justice  Programs 

LeToya  Bryant 

Audit  Liaison 

Office  of  Justice  Programs 

OAAG  Executive  Secretariat 
Control  No.  20012198 
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See  comment  1 . 


See  comment  2. 


See  comment  3. 


See  p.  19. 


See  comment  4. 


See  comment  5. 


Enclosure 

OJP’s  Specific  Comments  on  the  GAO  Draft  Report  Entitled: 

“JUSTICE  DISCRETIONARY  GRANTS:  Byrne  and  Violence  Against  Women  Office 
Grant  Monitoring  Should  Be  Better  Documented”  (GAO-02-25) 

1 .  On  page  1 ,  P'  paragraph,  between  the  3'“*  and  4*  sentences,  we  recommend  inserting: 

“For  example,  in  fiscal  year  1996,  VAWO  awarded  92  discretionary  grants  worth  about 
$12  million,  and  in  fiscal  year  2000,  VAWO  awarded  425  discretionary  grants  worth 
about  $125  million,” 

2.  On  page  1 ,  in  the  footnote,  we  recommend  inserting  the  bolded  text: 

“The  Edward  Byrne  Memorial.. .within  BJA,  but  is  one  of  approximately  20  distinct 
programs  administered  by  BJA.” 

3.  On  page  1,  we  recommend  inserting  a  footnote  to  explain: 

“An  examination  of  the  Office  of  the  Comptroller’s  financial  monitoring  was  not 
conducted  because  this  work  is  included  in  OJP’s  annual  financial  statement  audit.” 

4.  On  pages  2-3,  last  sentence,  we  recommend  inserting  the  bolded  text: 

“For  the  VAWO  files,. ..site  visits  occurred.  This  may  be  a  result  of  past  practice  by 
which  all  VAWO  Grant  Managers  Memoranda  included  a  standard  monitoring 
plan  that  was  developed  In  FY  1995,  when  VAWO  was  responsible  for  monitoring 
one  formula  and  one  small  discretionary  grant  program.” 

5.  On  page  3,  P'  bullet  (as  well  as  other  references  throughout  the  report),  referring  to  grant 
files  not  containing  financial  reports  covering  the  full  grant  period:  Please  note,  there  is 
no  OJP  or  Federal  grant  requirement  that  the  grant  file  contain  a  discrete  Financial  Status 
Report  (FSR)  form  for  each  quarter  the  grant  is  active.  Furthermore,  OJP  permits  their 
grantees  to  submit  FSRs  that  cover  previously  unreported  periods.  Additionally,  OJP  has 
controls  in  place  that  are  audited  annually  during  the  financial  statement  audit  process 
that  confirms  these  reporting  controls  are  operating  as  intended. 

6.  On  page  3,  J'**  bullet,  referring  to  closed  grants  not  containing  final  progress  and  financial 
reports:  Please  note,  during  the  programmatic  and  fiscal  closure  process,  OJP  obtains  a 
final  Financial  Status  Report  and  required  programmatic  reports,  and  those  reports  and 
other  closeout  documentation  are  forwarded  to  the  official  grant  file.  Although  the  grant 
period  may  have  ended  at  the  time  of  GAO’s  review,  the  programmatic  and  fiscal  closure 
process  may  not  have  been  completed. 
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See  comment  6. 


See  footnote  28. 


See  comment  2. 


See  comment  7. 


7.  On  page  3,  P'  full  paragraph,  P*  sentence,  we  recommend  inserting  the  bolded  text: 

“BJA  and  VAWO  are  not  positioned.. .monitoring  requirements  by  checking  grant  files 
for  documentation...” 

This  statement  is  more  accurate,  as  VAWO  oversees  staff  compliance  with  monitoring 
requirements  through  alternative  means,  such  as  one-on-one  meetings. 

8.  On  page  3,  P‘  full  paragraph,  after  the  second  sentence,  we  recommend  inserting: 

“However,  in  addition,  VAWO  receives  feedback  fi'om  grantees  and  those  receiving 
services  from  grantees,  as  well  as  attend  training  events  in  which  grantees  participate,  all 
of  which  assist  staff  to  monitor  grants.” 

9.  On  page  5,  first  sentence,  we  recommend  revising  the  sentence  to  read  as  follows  to 
clarify  and  correct  the  sentence: 

“In  fulfilling  its  mission,  BJA  provides  grants  for  site-based  programs  and  for  training 
and  technical  assistance  to  combat  violence  and  drug-related  crime  and  help  improve  the 
criminal  justice  system.” 

10.  On  page  7,  we  recommend  inserting  the  following  after  the  end  of  the  partial  paragraph: 
“The  Byrne  program  is  one  of  approximately  20  programs  administered  by  BJA.” 

11.  On  page  7,  we  recommend  replacing  the  P‘  full  paragraph  with  the  following  for 
accuracy: 

“VAWO,  and  its  counterpart,  VAWGO,  were  created  in  1995  to  implement  the  Violence 
Against  Women  Act  of  1994  (VAWA).  The  Victims  of  Trafficking  and  Violence 
Protection  Act  of  2000  (P.L.  106-386)  reauthorized  critical  grant  programs  created  by  the 
VAWA  and  subsequent  legislation,  established  new  grant  programs,  and  strengthened 
federal  law.  VAWO’s  mission  is  to  lead  the  national  effort  to  end  violence  against 
women,  including  domestic  violence,  sexual  assault,  and  stalking.  VAWA  programs 
improve  criminal  justice  system  responses  to  these  crimes  by  providing  support  for  law 
enforcement,  prosecution,  courts,  and  victim  advocacy  programs  across  the  country.  In 
addition,  programs  enhance  direct  services  for  victims,  including  victim  advocacy, 
emergency  shelter,  legal  services.  VAWO  also  addresses  violence  against  women  issues 
internationally,  including  working  to  prevent  trafficking  in  persons. 
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In  fiscal  year  1996,  VAWO  awarded  92  discretionary  grants  worth  about  $12  million,  and 
in  fiscal  year  2000,  VAWO  awarded  425  discretionary  grants  worth  about  $125  million. 

VAWO’s  staffing  resources  have  not  kept  pace  with  the  dramatic  growth  of  the 
program..” 

Now  footnote  9. 

12. 

On  page  8,  footnote  7,  we  recommend  inserting  the  following  bolded  text: 

“A  grant  consists  of  an  initial  award,  any  subsequent  supplemental  awards  and  Grant 

Adjustment  Notices.” 

Grant  Adjustment  Notices  are  part  of  a  grant  as  they  commimicate  approval  of  project 
period  changes,  budget  changes,  etc. 

13. 

On  page  10,  3'*'  paragraph,  2"'*  sentence,  we  recommend  replacing  “all”  with  “most”  for 
accuracy.  Further,  the  3“*  sentence  of  the  same  paragraph,  the  following  bolded  text 
should  be  added:  “Generally,  each  of  the  BJA  program  managers  had...” 

The  20  program  managers  in  the  State  and  Local  Assistance  Program  Division  handle 
about  95%  of  the  non-formula  grants,  while  a  few  such  grants  are  handled  by  staff  in  the 
other  three  divisions. 

14. 

On  page  10,  3"*  paragraph,  d*  sentence,  we  recommend  replacing  “15  program  managers” 
with  “13  program  managers”  for  accuracy. 

15. 

On  page  1 1,  last  sentence,  the  following  bolded  text  should  be  inserted  to  clarify  the 
sentence: 

“However,  BJA  and  VAWO  grant  managers...” 

See  comment  8. 

16. 

On  page  12,  Section  Title,  we  recommend  inserting  the  following  bolded  text: 

“Missing  Program  Monitoring  Plans  and  Inadequately  Documented  Program 

Monitoring  Activities” 

The  title  as  stated  implies  that  the  report  is  referring  to  financial  monitoring  as  well. 

However,  as  stated  on  pages  2  and  9  of  the  report,  financial  monitoring  was  not  a  part  of 
your  review. 

See  p.  20. 

17. 

On  page  14,  T'  bullet,  after  the  sentence,  we  recommend  adding: 

“However,  since  the  release  of  the  OJP  Grant  Management  Policies  and  Procedures 

Manual,  VAWO  has  developed  a  standard  Desk  Review  Checklist  that  is  now  being 
utilized. 
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See  comment  9. 


Now  on  p.  19. 


Now  on  p.  19. 


See  comment  10. 


Now  on  p.  21 . 
Now  on  p.  21 . 


18.  On  page  1 5,  at  the  end  of  the  1"  full  paragraph,  we  recommend  inserting: 

“However,  since  grant  managers  often  obtain  information  about  a  grantee’s  progress  in 
alternative  ways  (e.g.,  feedback  from  those  receiving  services  from  grantees),  this  may 
simply  be  undocumented  in  the  grant  files.” 

19.  On  page  18,  at  the  end  of  the  2"'*  full  paragraph,  last  sentence,  we  recommend  inserting 
the  following  bolded  text: 

“Both  BJA  and  VAWO  officials  said  that  since  1995,  grant  managers. ..volume  of  grants 
and  process  new  grants  each  fiscal  year,  but  also...” 

20.  On  page  18,  footnote  25,  we  recommend  inserting  the  following  bolded  text: 

“For  example,  for  VAWO,  the  Higher.. .(20  U.S.C.  1 1 52).  For  BJA,  Community 
Prosecution,  Tribal  Courts,  etc.” 

21.  On  page  19,  in  the  1"  full  paragraph,  7“’  sentence,  we  recommend  revising  the  sentence  to 
read  as  follows  and  inserting  an  additional  paragraph  for  clarification: 

“At  the  time  of  our  review,  BJA  indicated  that  it  expected  to  put  these  procediues  into 
practice  in  FY  2002. 

VAWO  has  also  been  working  on  developing  policies  and  procedures  for  monitoring 
grantees  more  effectively.  A  VAWO  Monitoring  Working  Group  was  formed  in  the 
Spring  of  2001.  The  group  is  working  to  develop  a  risk-based  assessment  tool  to  develop 
more  realistic  monitoring  plans;  pre-,  post-,  and  on-site  protocols  for  site  visits;  a 
standard  site  visit  report  form;  and  a  comprehensive  training  program  on  monitoring  for 
new  employees.  VAWO  has  developed  a  Desk  Review  Checklist  that  will  begin  to  be 
used  in  fiscal  year  2002.  In  addition,  VAWO  has  developed  a  management  information 
system;  the  system  will  eventually  be  able  to  track  the  submission  of  progress  and 
financial  status  reports,  and  a  process  will  be  put  in  place  to  follow-up  with  grantees  who 
are  delinquent. 

OJP  requires  documentation...” 

22.  On  page  20,  first  paragraph,  4"‘  sentence,  we  recommend  changing  “develop”  to  “modify” 
for  aecuracy. 

23.  On  page  20,  first  paragraph,  5“'  sentence,  we  recommend  inserting  the  following  bolded 
text: 

“According  to  BJA  officials,  the  enhanced  system.. .tracked” 
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Now  on  p.  21 . 


Now  on  pp.  21-22. 


See  footnote  34. 


See  comment  1 1 . 


See  comment  12. 


See  comment  1 . 


See  comment  13. 


24.  On  page  20,  first  paragraph,  6“'  sentence,  we  recommend  inserting  the  following  bolded 
text: 

“However,  at  the  time  of  our  review,  the  system  was  still  in  the  developmental  stage,  and 
the  monitoring  portion  was  deployed  in  October  2001.” 

25.  On  page  20,  2"‘‘  full  paragraph,  at  the  end  of  the  5*  sentence,  we  recommend  adding: 

“and  submission  of  progress  and  financial  status  reports.” 

26.  On  page  24,  last  paragraph,  after  2'“‘  sentence,  we  recommend  inserting  the  following 
text: 

“The  OC  already  utilizes  a  Financial  Monitoring  Tracking  System  to  manage  financial 
monitoring  activities  and  capture  financial  monitoring  information.” 

27.  On  page  26,  2"**  full  paragraph,  in  the  d*  sentence,  we  recommend  inserting  the  following 
bolded  text  for  accuracy: 

“The  lack  of  systematic  data...  can  determine  through  examining  grant  files  ...their 
activities.” 

28.  On  page  26,  2”"'  full  paragraph,  last  sentence,  we  recommend  deleting  this  sentence.  We 
believe  that  this  implies  that  the  need  to  improve  grant  file  documentation  relates  to 
effectively  and  responsibly  managing  discretionary  grant  funds. 

29.  On  page  29,  P*  paragraph,  last  sentence,  we  recommend  deleting  the  sentence  and 
inserting  the  following  text: 

“Following  the  creation  of  VAWO  in  1995,  the  yearly  number  of  discretionary  awards 
and  total  dollar  amount  of  those  awards  increased  dramatically,  from  92  awards  worth 
$12  million  in  1996  to  425  awards  worth  $125  million  in  2000.” 

30.  On  page  29,  P'  paragraph,  2"'*  sentence,  we  recommend  inserting  the  following  bolded 
text  to  clarify: 

“According  to  data  we  obtained  from  OJP,  the  yearly  number  of  BJA  discretionary 
awards  and  total  dollar  amount  have  fluctuated  somewhat  but  generally  increased  in  the 
1990s. 

In  addition,  in  the  same  ptnagraph,  we  recommend  the  sentence  begitming  “Furthermore, 
while  the...”  be  deleted. 
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Now  on  p.  36.  31.  On  page  34,  P‘  paragraph,  S""  and  J""  sentences,  we  recommend  inserting  the  following 

bolded  text  to  clarify: 

With  some  discretionary  grant  programs,  OJP  has  some.. .as  grantees.  Some 
discretionary  awards  are  competitive,  while  others  are  non-competitive,  owing 
to.. .potential  recipients.” 

Now  on  pp.  37-38.  32.  On  pages  34  and  35,  referring  to  Figure  8,  please  note  that  supplemental  grants 

automatically  extend  the  grant  period  for  the  project.  There  is  only  one  closeout  per 
grant,  i.e.  at  the  end  of  the  grant  period  including  all  no-cost  extensions  and  extensions  of 
the  award  period  through  supplements. 

On  page  35,  the  last  paragraph  should  be  revised  as  follows  and  inserted  after  the  second 
paragraph  (“In  addition  to  the  grant...”): 

“Delete  T“  sentence  of  paragraph.  OJP  is  to  apply  the  same.. .award  of  a  grant.  When  the 
grantee  requires  supplemental  funding,  the  grantee  must  repeat  the  application  process.” 

Figure  8  is  not  accurate.  The  captions  “Close  out”  should  be  deleted  in  relation  to  the 
original  award,  supplemental  award,  and  second  supplemental  award,  but  should  be 
inserted  in  relation  to  the  third  supplemental  award. 

See  comment  1 4  33.  The  following  list  of  duties  of  VAWO  staff  may  provide  additional  context  for  the  draft 

report: 

The  Violence  Against  Women  Office  (VAWO)  is  organized  into  three  divisions  that 
work  in  close  collaboration  to  accomplish  its  mission: 

The  Policy  Division,  in  coordination  with  the  Office  of  General  Counsel,  provides  policy 
analyses  regarding  VAWA  and  related  legislation  and  supplies  related  materials  as 
needed  to  the  White  House,  the  Attorney  General,  DOJ  components  and  federal  agencies, 
the  general  public,  state  and  local  officials,  and  crime  victims. 

The  Program  Development  Division  is  responsible  for  overseeing  the  creation, 
development,  and  implementation  of  all  of  the  VAWO  grant  programs,  including 
developing  and  overseeing  the  demonstration  initiatives,  technical  assistance,  and  the 
preparation  of  annual  reports  to  Congress  on  the  effectiveness  of  grant  programs 
administered  by  VAWO. 

The  Program  Management  Division  is  responsible  for  overseeing,  managing  and 
monitoring  the  majority  of  formula  and  discretionary  grant  awards  administered  by 
VAWO. 
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Below  is  a  more  detailed  breakdown  of  the  responsibilities  of  The  Program  Management 
Division: 

Program  Management  Division 

Collaborates  with  the  Program  Development  Division  on  the  processing  of  all  STOP 
Violence  Against  Women  Formula  Grant  Awards; 

Assists  State  Administrators  of  the  STOP  Violence  Against  Women  Formula  grants  in 
the  development  of  implementation  plans  to  address  violence  against  women  in  states; 

Collaborates  with  the  Program  Development  Division  in  the  final  negotiation  of 
discretionary  grant  awards  including  final  negotiation  of  activities,  staffing  plans, 
deliverables,  project  time  line,  final  budget  and  special  conditions; 

Ensures  that  new  grantees  have  submitted  all  required  forms  and  certifications  specific  to 
each  grant  program; 

Collaborates  with  the  Office  of  the  Comptroller  (OC)  on  final  budget  clearance  and 
resolution  of  ongoing  budget  issues; 

Prepares  official  Grant  Manager’s  Memos  and  Project  Summaries  that  describe  project 
activities  negotiated  during  final  awards  processing; 

Prepares  and  assembles  all  other  award  documents  using  OJP’s  online  Grants 
Management  System; 

Coordinates  and  tracks  grant  awards  throughout  the  processing  stage; 

Responds  to  questions  firom  grantees  regarding  statutory  and  programmatic  requirements; 

Engages  in  problem-solving  with  grantees  encountering  barriers  implementing  local 
projects,  ensuring  that  appropriate  technical  assistance  is  made  available; 

Conducts  site  visits  (and  to  the  extent  possible,  partners  with  OC  for  a  joint  site  visit)  to 
determine  knowledge  of  promising  practices,  level  of  coordinated  community  response, 
grantee  performance,  adherence  to  substantive  special  conditions,  quality  of  data 
collection  to  measure  program  impact,  fiscal  compliance  and  to  identify  technical 
assistance  needs; 

Assists  STOP  Violence  Against  Indian  Women  grant  recipients  in  the  development  of 
implementation  plans  to  address  violence  against  women  in  Native  communities; 
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•  Reviews  and  approves  programmatic  and  budget  changes  to  original  application; 

•  Monitors  grantee  performance  and  compliance  with  statutory  and  programmatic 
requirements; 

•  Processes  grant  adjustment  notices; 

•  Reviews  and  approves  grantee  requests  to  attend  training  and  technical  assistance  events; 

•  Reviews  and  approves  grantee  products  and  deliverables; 

•  Reviews  bi-aimual  progress  reports  and  follows  up  on  any  programmatic  issues  of 
concern; 

•  Reviews  and  tracks  compliance  with  financial  status  report  submissions; 

•  Monitors  the  draw  down  of  funds; 

•  Collaborates  with  other  parts  of  OJP,  such  as  OC,  Office  of  Civil  Rights,  and  Office  of 
General  Counsel  to  coordinate  grant  management  efforts; 

•  Initiates  the  closeout  of  grants,  including  writing  a  final  report  and  collecting  any  missing 
information  from  the  grantee  for  the  file; 

•  Represents  VAWO  on  OJP  working  groups; 

•  Responds  to  internal  DOJ  requests  for  information  on  grant  programs  and  specific  trends 
in  violence  against  women  issues;  and 

•  Assists  OC  staff  accountants  on  Office  of  the  Inspector  General  audit  resolutions. 
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The  following  are  GAO’s  comments  on  the  Department  of  Justice’s 
November  9,  2001,  letter. 


GAO  Comments 


We  report  on  the  growth  in  the  number  and  dollar  amount  of  VAWO 
discretionary  grants  since  fiscal  year  1996  in  appendix  1  (see  pp.  34-35). 


2.  We  have  amended  the  Background  section  of  the  report  to  add  this 
information  (see  p.  6). 


3.  We  disagree.  As  we  stated  in  the  report  (see  p.  2),  financial  monitoring 
was  not  within  the  scope  of  our  work.  It  is  important  to  note  that  the 
scope  of  our  work  was  based  on  agreements  with  our  requesters  and 
was  not  influenced  by  whether  or  not  financial  monitoring  information 
is  included  in  OJP’s  annual  financial  statement  audit. 


4.  According  to  the  OJP  Handbook:  Policies  and  Procedures  for  the 
Administration  of  OJP  Grants  (Feb.  1992),  official  grant  files  kept  by 
the  Office  of  Comptroller  Control  Desk  are  to  contain  documents 
relating  to  each  grantee,  including  progress  and  financial  reports  and 
site  visit  reports.  In  addition,  for  documentation  to  be  readily  available 
for  examination,  as  required  by  the  Comptroller  General’s  internal 
control  standards,  keeping  them  in  the  official  grant  files  seems 
appropriate. 

5.  As  we  reported,  in  our  review  of  closeout  procedures,  we  waited  more 
than  the  required  180  days  before  reviewing  grant  files  to  allow 
sufficient  time  for  BJA  and  VAWO  to  complete  the  grant  closeout 
process  (see  footnote  24,  p.  18).  However,  the  files  we  reviewed  did 
not  contain  the  required  closeout  documents. 

6.  As  we  reported,  BJA  and  VAWO  officials  told  us  that  supervisors 
discuss  monitoring  activities  with  staff  through  informal  discussions  or 
meetings,  which  could  include  one-on-one  meetings  with  staff.  As  we 
stated,  it  is  possible  that  grant  managers  are  conducting  grant 
monitoring  activities  even  if  no  documentation  exists.  However, 
without  documentation,  neither  OJP,  BJA,  VAWO,  nor  we  are 
positioned  to  tell  with  any  certainty  whether  such  monitoring  occurred 
(see  pp.  20-21). 

7.  We  have  amended  the  report  to  add  some  of  this  information  (see  p.  7). 
As  discussed  in  comment  1,  we  report  on  the  growth  in  the  number 
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and  dollar  amount  of  VAWO  discretionary  grants  in  appendix  1  (see  pp. 
34-35). 

8.  We  disagree.  Financial  monitoring  was  not  part  of  our  review  as 
clearly  stated  in  our  introduction.  Therefore,  we  do  not  believe  that  the 
title  of  this  section,  as  stated,  implies  that  financial  monitoring  was 
part  of  our  review. 

9.  We  agree  that  the  grant  files  did  not  always  contain  documentation  and 
acknowledge  that  the  lack  of  documentation  does  not  necessarily 
indicate  whether  monitoring  did  or  did  not  occur.  As  we  stated  in 
comment  6,  without  required  progress  reports  and  other 
documentation,  neither  OJP,  BJA,  VAWO,  nor  we  are  positioned  to  tell 
with  any  certainty  whether  such  monitoring  occurred. 

10.  We  have  amended  the  report  to  add  most  of  this  information  (see  p. 

20).  A  discussion  of  the  development  of  VAWO’s  management 
information  system  can  be  found  on  page  21  of  the  report. 

11.  As  discussed  in  comment  6  and  as  we  reported,  it  is  possible  that  grant 
managers  are  conducting  grant  monitoring  activities  even  if  no 
documentation  exists.  However,  without  documentation,  neither  OJP, 
BJA,  VAWO,  nor  we  are  positioned  to  tell  with  any  certainty  whether 
such  monitoring  occurred. 

12.  We  disagree.  As  we  reported,  the  Comptroller  General’s  internal 
control  standards  require  that  all  transactions  and  other  significant 
events  be  clearly  documented  and  that  the  documentation  be  readily 
available  for  examination.  Appropriate  documentation  is  an  internal 
control  activity  to  help  ensure  that  management’s  directives  are 
carried  out.  Without  such  documentation,  OJP,  BJA,  and  VAWO  have 
no  assurance  that  grants  are  meeting  their  goals  and  funds  are  being 
used  properly. 

13.  We  have  amended  the  report  to  incorporate  the  first  of  these  two 
changes  (see  p.  31).  However,  as  illustrated  in  figures  3  and  4,  the 
annual  number  of  Byrne  awards  and  the  dollar  amount  of  those  awards 
have  generally  increased,  although  there  were  some  yearly  decreases 
(see  pp.  33-34). 

14.  We  reported  that,  according  to  VAWO  officials,  VAWO  grant  managers 
have  sometimes  been  responsible  for  additional  duties  beyond  grant 
monitoring  over  the  last  few  years  (see  p.  19). 
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GAO’S  Mission 

The  General  Accounting  Office,  the  investigative  arm  of  Congress,  exists  to 
support  Congress  in  meeting  its  constitutional  responsibilities  and  to  help 
improve  the  performance  and  accoimtability  of  the  federal  government  for  the 
American  people.  GAO  examines  the  use  of  public  funds;  evaluates  federal 
programs  and  policies;  and  provides  analyses,  recommendations,  and  other 
assistance  to  help  Congress  make  informed  oversight,  policy,  and  fimding 
decisions.  GAO’s  commitment  to  good  government  is  reflected  in  its  core  values 
of  accountability,  integrity,  and  reliability. 

Obtaining  Copies  of 
GAO  Reports  and 
Testimony 

The  fastest  and  easiest  way  to  obtain  copies  of  GAO  documents  is  through  the 
Internet.  GAO’s  Web  site  (www.gao.gov)  contains  abstracts  and  full-text  files  of 
current  reports  and  testimony  and  an  expanding  archive  of  older  products.  The 
Web  site  features  a  search  engine  to  help  you  locate  documents  using  key  words 
and  phrases.  You  can  print  these  documents  in  their  entirety,  including  charts  and 
other  graphics. 

Each  day,  GAO  issues  a  list  of  newly  released  reports,  testimony,  and 
correspondence.  GAO  posts  this  list,  known  as  “Today’s  Reports,”  on  its  Web  site 
daily.  The  list  contains  links  to  the  full-text  document  files.  To  have  GAO  E-mail 
this  list  to  you  every  afternoon,  go  to  our  home  page  and  complete  the  easy-to-use 
electronic  order  form  found  under  “To  Order  GAO  Products.” 

Order  by  Mail  or  Phone 

The  first  copy  of  each  printed  report  is  free.  Additional  copies  are  $2  each.  A 
check  or  money  order  should  be  made  out  to  the  Superintendent  of  Documents. 
GAO  also  accepts  VISA  and  Mastercard.  Orders  for  100  or  more  copies  mailed  to  a 
single  address  are  discoimted  25  percent.  Orders  should  be  sent  to: 

U.S.  General  Accoimting  Office 

P.O.  Box  37050 

Washington,  D.C.  20013 

To  order  by  phone:  Voice:  (202)  512-6000 

TDD:  (301)  413-0006 

Fax:  (202)  258-4066 

Visit  GAO’s  Document 
Distribution  Center 

GAO  Building 

Room  1100,  700  4th  Street,  NW  (comer  of  4th  and  G  Streets,  NW) 

Washington,  D.C.  20013 

To  Report  Fraud, 
Waste,  and  Abuse  in 
Federal  Programs 

Contact: 

Web  site:  www.gao.gov/fraudnet/fraudnet.htm. 

E-mail:  fraudnet@gao.gov,  or 

1-800-424-5454  (automated  answering  system). 
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Jeff  Nelligan,  Managing  Director,  NelliganJ@gao.gov  (202)  512-4800 

U.S.  General  Accounting  Office,  441  G.  Street  NW,  Room  7149, 

Washington,  D.C.  20548 
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